Jul 13 18:30:03.012750 ip-10-0-131-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 18:30:03.012763 ip-10-0-131-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 18:30:03.012770 ip-10-0-131-162 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 18:30:03.013010 ip-10-0-131-162 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 18:30:13.160667 ip-10-0-131-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 13 18:30:13.160691 ip-10-0-131-162 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e13d41d827474d4e872c0b27be8c63a0 --
Jul 13 18:31:52.793792 ip-10-0-131-162 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 18:31:53.182348 ip-10-0-131-162 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 18:31:53.182348 ip-10-0-131-162 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 18:31:53.182348 ip-10-0-131-162 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 18:31:53.183028 ip-10-0-131-162 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 18:31:53.183028 ip-10-0-131-162 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 18:31:53.183028 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.182416    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 18:31:53.189135 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189113    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:31:53.189135 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189131    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:31:53.189135 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189135    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:31:53.189135 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189139    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:31:53.189135 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189142    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189145    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189149    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189152    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189154    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189157    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189160    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189162    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189165    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189167    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189169    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189172    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189175    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189177    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189180    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189182    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189185    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189187    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189190    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189192    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:31:53.189379 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189194    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189199    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189202    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189205    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189208    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189211    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189213    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189217    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189222    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189225    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189228    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189231    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189234    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189237    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189240    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189244    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189247    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189250    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189253    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:31:53.189879 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189255    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189258    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189260    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189262    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189265    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189267    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189270    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189272    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189275    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189277    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189280    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189282    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189285    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189287    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189289    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189292    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189294    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189296    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189299    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189301    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:31:53.190337 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189304    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189306    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189308    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189311    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189322    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189325    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189328    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189332    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189335    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189337    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189340    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189342    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189345    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189348    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189350    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189354    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189357    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189359    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189362    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:31:53.190841 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189364    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189369    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189372    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189375    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189377    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189380    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189383    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189386    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189388    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189391    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189393    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189396    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189399    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189401    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189404    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189406    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.189408    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190148    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190156    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:31:53.191296 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190160    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190162    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190165    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190167    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190170    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190172    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190175    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190178    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190180    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190183    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190186    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190189    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190191    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190194    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190196    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190199    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190202    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190204    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190207    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190209    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:31:53.191776 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190212    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190216    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190219    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190223    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190228    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190232    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190235    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190238    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190241    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190243    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190246    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190249    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190252    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190254    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190257    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190259    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190262    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190264    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190267    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:31:53.192301 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190269    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190272    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190275    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190277    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190280    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190282    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190285    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190287    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190289    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190292    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190295    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190297    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190299    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190301    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190304    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190306    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190309    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190311    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190313    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190316    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:31:53.192781 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190319    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190322    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190325    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190327    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190330    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190332    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190335    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190337    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190339    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190342    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190345    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190350    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190353    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190355    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190357    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190360    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190362    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190365    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190367    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190370    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:31:53.193271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190372    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190374    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190377    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190380    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190382    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190384    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190387    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190389    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190392    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190394    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190397    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190399    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190401    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190404    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190407    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190409    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190412    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190414    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190796    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190801    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:31:53.193869 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190804    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190807    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190810    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190814    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190817    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190819    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190822    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190824    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190826    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190829    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190832    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190834    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190836    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190839    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190842    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190845    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190847    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190850    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190852    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190855    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:31:53.194352 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190857    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190860    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190863    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190865    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190868    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190872    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190876    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190879    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190881    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190884    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190886    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190889    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190891    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190893    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190896    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190899    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190901    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190903    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190907    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:31:53.194848 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190909    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190911    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190914    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190916    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190919    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190921    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190924    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190926    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190929    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190931    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190933    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190936    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190938    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190941    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190943    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190945    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190948    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190950    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190953    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190958    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:31:53.195324 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190960    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190963    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190965    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190968    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190970    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190973    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190975    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190979    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190983    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190985    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190988    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190991    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190993    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190996    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.190998    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191000    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191003    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191005    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191008    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:31:53.195832 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191010    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191012    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191015    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191017    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191021    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191025    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191028    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191031    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191034    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191036    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191039    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191041    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191045    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191047    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191050    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191053    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191055    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191057    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191060    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191126    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 18:31:53.196289 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191133    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191140    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191144    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191148    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191151    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191155    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191159    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191162    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191165    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191168    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191171    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191174    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191177    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191180    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191183    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191186    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191189    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191193    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191196    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191199    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191202    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191206    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191209    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 18:31:53.196781 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191212    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191216    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191219    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191222    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191225    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191228    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191231    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191233    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191237    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191240    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191243    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191246    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191249    2565 flags.go:64] FLAG: --enable-server="true"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191252    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191256    2565 flags.go:64] FLAG: --event-burst="100"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191259    2565 flags.go:64] FLAG: --event-qps="50"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191261    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191264    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191267    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191270    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191273    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191276    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191279    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191282    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191285    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 18:31:53.197373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191288    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191291    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191294    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191296    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191299    2565 flags.go:64] FLAG: --feature-gates=""
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191303    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191306    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191309    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191313    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191316    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191319    2565 flags.go:64] FLAG: --help="false"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191321    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191324    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191327    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191330    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191333    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191336    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191340    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191343    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191346    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191348    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191351    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191354    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191357    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 13 18:31:53.198047 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191359    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191362    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191365    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191368    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191371    2565 flags.go:64] FLAG: --lock-file=""
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191373    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191376    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191379    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191384    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191387    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191390    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191393    2565 flags.go:64] FLAG: --logging-format="text"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191395    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191398    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191401    2565 flags.go:64] FLAG: --manifest-url=""
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191404    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191408    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191412    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191415    2565 flags.go:64] FLAG: --max-pods="110"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191418    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191421    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191424    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191426    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191429    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191432    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 18:31:53.198644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191438    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191445    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191448    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191451    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191454    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191457    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191462    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191465    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191483    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191485    2565 flags.go:64] FLAG: --port="10250"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191488    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191491    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07ec255847d0d437d"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191495    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191498    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191501    2565 flags.go:64] FLAG: --register-node="true"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191503    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191507    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191511    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191514    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191516    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191520    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191523    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191526    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191528    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191532    2565 flags.go:64] FLAG: --runonce="false"
Jul 13 18:31:53.199253 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191535    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191538    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191541    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191543    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191546    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191549    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191552    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191556    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191559    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191562    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191564    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191567    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191570    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191573    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191575    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191580    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191583    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191586    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191590    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191592    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191595    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191598    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191600    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191603    2565 flags.go:64] FLAG: --v="2"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191607    2565 flags.go:64] FLAG: --version="false"
Jul 13 18:31:53.199852 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191611    2565 flags.go:64] FLAG: --vmodule=""
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191614    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.191618    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191725    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191729    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191732    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191736    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191739    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191741    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191744    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191747    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191750    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191752    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191755    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191759    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191762    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191764    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191766    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191769    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191771    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:31:53.200452 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191774    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191777    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191779    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191782    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191785    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191788    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191792    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191795    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191798    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191801    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191804    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191806    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191809    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191812    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191815    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191818    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191820    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191823    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191827    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:31:53.200962 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191829    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191832    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191834    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191837    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191840    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191842    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191844    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191848    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191850    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191853    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191855    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191859    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191863    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191865    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191868    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191871    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191873    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191876    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191878    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191880    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:31:53.201438 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191883    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191885    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191888    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191890    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191893    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191895    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191898    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191900    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191903    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191905    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191907    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191912    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191914    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191917    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191919    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191922    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191924    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191927    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191929    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191933    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:31:53.201952 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191935    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191937    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191940    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191942    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191946    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191949    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191952    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191955    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191957    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191960    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191962    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191964    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191967    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191969    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191971    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191974    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191976    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191979    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191981    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:31:53.202430 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191983    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191986    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191989    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.191991    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.192540    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.199273    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.199290    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.199303    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.199309    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199371    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199376    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199380    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199383    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199385    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199388    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:31:53.202941 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199391    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199393    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199396    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199398    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199401    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199403    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199405    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199408    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199411    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199413    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199416    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199418    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199421    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199423    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199426    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199428    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199431    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199433    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199436    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199438    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:31:53.203307 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199441    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199443    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199446    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199455    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199458    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199460    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199463    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199480    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199483    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199485    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199488    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199490    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199493    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199496    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199498    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199501    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199503    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199506    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199508    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199511    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:31:53.203806 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199513    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199516    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199518    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199521    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199523    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199526    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199528    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199532    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199536    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199539    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199542    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199544    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199547    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199550    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199552    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199555    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199566    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199569    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199571    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:31:53.204309 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199574    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199577    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199579    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199581    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199584    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199586    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199589    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199592    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199596    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199598    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199601    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199604    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199607    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199609    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199611    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199614    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199616    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199619    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199621    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199624    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:31:53.204828 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199626    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199629    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199631    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199634    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199636    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199639    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199642    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199644    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199647    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199651    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199661    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199664    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199666    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199669    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:31:53.205299 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.199674    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199809    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199814    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199817    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199820    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199822    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199824    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199827    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199829    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199832    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199836    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199839    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199842    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199845    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199848    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199850    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199853    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199855    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199858    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199861    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:31:53.205673 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199863    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199866    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199868    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199871    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199874    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199877    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199880    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199882    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199885    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199892    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199895    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199897    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199899    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199902    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199904    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199906    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199909    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199911    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199913    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199915    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:31:53.206147 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199918    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199920    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199922    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199925    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199927    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199929    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199932    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199934    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199936    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199939    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199941    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199943    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199946    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199948    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199951    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199953    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199956    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199958    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199960    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:31:53.206743 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199964    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199967    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199970    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199979    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199982    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199985    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199987    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199990    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199992    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199995    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199997    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.199999    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200002    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200004    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200006    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200009    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200011    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200013    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200016    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:31:53.207195 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200018    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200021    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200025    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200028    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200030    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200032    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200035    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200037    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200039    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200042    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200045    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200047    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200049    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200052    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200054    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200056    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200059    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200066    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200069    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:31:53.207756 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200071    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:31:53.208323 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200074    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:31:53.208323 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:53.200076    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:31:53.208323 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.200081    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 18:31:53.208323 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.200188    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 18:31:53.208323 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.202613    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 18:31:53.208323 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.203926    2565 server.go:1019] "Starting client certificate rotation"
Jul 13 18:31:53.208323 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.204038    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 18:31:53.208323 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.204077    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 18:31:53.208323 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.206498    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 18:31:53.209665 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.209644    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 18:31:53.222780 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.222755    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 13 18:31:53.225531 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.225515    2565 log.go:25] "Validated CRI v1 image API"
Jul 13 18:31:53.226326 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.226312    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 18:31:53.228914 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.228891    2565 fs.go:135] Filesystem UUIDs: map[14c25dcd-b580-48a5-9840-700ba810fdbb:/dev/nvme0n1p4 430c6f8d-bfd4-4a98-b938-f929ec41e9ce:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 13 18:31:53.228968 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.228915    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 18:31:53.235299 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.235193    2565 manager.go:216] Machine: {Timestamp:2026-07-13 18:31:53.233771619 +0000 UTC m=+0.320877087 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094797 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2599fa923577d8c18bd3a81829ccbb SystemUUID:ec2599fa-9235-77d8-c18b-d3a81829ccbb BootID:e13d41d8-2747-4d4e-872c-0b27be8c63a0 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:a1:75:13:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:a1:75:13:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:e8:9b:cc:be:68 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 18:31:53.235299 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.235297    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 18:31:53.235410 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.235368    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 18:31:53.238665 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.238632    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 18:31:53.238812 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.238672    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 18:31:53.239498 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.239489    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 18:31:53.239528 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.239500    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 18:31:53.239528 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.239507    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 18:31:53.240267 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.240257    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 18:31:53.241306 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.241291    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 18:31:53.241874 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.241864    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 18:31:53.245097 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.245086    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 18:31:53.245373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.245363    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 18:31:53.245409 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.245397    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 18:31:53.245437 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.245411    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 18:31:53.245481 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.245435    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 18:31:53.245481 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.245452    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 13 18:31:53.245481 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.245463    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 18:31:53.245795 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.245784    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 18:31:53.245841 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.245802    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 18:31:53.248215 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.248195    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 18:31:53.250569 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.250556    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 18:31:53.250625 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.250586    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 18:31:53.250802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.250792    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 18:31:53.250851 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.250807    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 18:31:53.250851 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.250814    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 18:31:53.250851 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.250819    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 18:31:53.250851 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.250827    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 18:31:53.250851 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.250832    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 18:31:53.251543 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.251532    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 18:31:53.251543 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.251543    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 18:31:53.251638 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.251549    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 18:31:53.251638 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.251555    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 18:31:53.251638 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.251563    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 18:31:53.251638 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.251571    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 18:31:53.252450 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.252442    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 18:31:53.252498 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.252451    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 18:31:53.255929 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.255914    2565 server.go:1268] "Started kubelet"
Jul 13 18:31:53.256019 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.255996    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 18:31:53.256342 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.256063    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 18:31:53.256342 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.256234    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 18:31:53.257054 ip-10-0-131-162 systemd[1]: Started Kubernetes Kubelet.
Jul 13 18:31:53.260945 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.260910    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 18:31:53.262702 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.262670    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 18:31:53.263029 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.263012    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 18:31:53.263274 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.263247    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 18:31:53.263371 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.263244    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 18:31:53.264748 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.264680    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 18:31:53.268751 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.267657    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-162.ec2.internal.18c1ed005e743490  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-162.ec2.internal,UID:ip-10-0-131-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-162.ec2.internal,},FirstTimestamp:2026-07-13 18:31:53.25588392 +0000 UTC m=+0.342989375,LastTimestamp:2026-07-13 18:31:53.25588392 +0000 UTC m=+0.342989375,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-162.ec2.internal,}"
Jul 13 18:31:53.269558 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.269537    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 18:31:53.269654 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.269553    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 18:31:53.269654 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.269646    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:53.270415 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270392    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 18:31:53.270415 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270412    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 18:31:53.270596 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270392    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 18:31:53.270596 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270447    2565 factory.go:55] Registering systemd factory
Jul 13 18:31:53.270596 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270463    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 13 18:31:53.270596 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270517    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 18:31:53.270596 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270525    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 18:31:53.270793 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270711    2565 factory.go:153] Registering CRI-O factory
Jul 13 18:31:53.270793 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270722    2565 factory.go:223] Registration of the crio container factory successfully
Jul 13 18:31:53.270793 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270769    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 18:31:53.270793 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270791    2565 factory.go:103] Registering Raw factory
Jul 13 18:31:53.270931 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.270802    2565 manager.go:1196] Started watching for new ooms in manager
Jul 13 18:31:53.271147 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.271130    2565 manager.go:349] Starting recovery of all containers
Jul 13 18:31:53.275876 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.275848    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 18:31:53.276010 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.275976    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 18:31:53.281684 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.281667    2565 manager.go:354] Recovery completed
Jul 13 18:31:53.283391 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.283355    2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 13 18:31:53.286511 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.286496    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:31:53.288234 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.288214    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:31:53.288305 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.288250    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:31:53.288305 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.288263    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:31:53.288856 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.288842    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 18:31:53.288921 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.288857    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 18:31:53.288921 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.288858    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:31:53.289017 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.288877    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 18:31:53.289703 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.289687    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:31:53.289777 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.289713    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:31:53.289777 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.289722    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:31:53.290053 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.290041    2565 policy_none.go:49] "None policy: Start"
Jul 13 18:31:53.290083 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.290058    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 18:31:53.290083 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.290068    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 18:31:53.290668 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.290598    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-162.ec2.internal.18c1ed006061d721  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-162.ec2.internal,UID:ip-10-0-131-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-162.ec2.internal,},FirstTimestamp:2026-07-13 18:31:53.288234785 +0000 UTC m=+0.375340244,LastTimestamp:2026-07-13 18:31:53.288234785 +0000 UTC m=+0.375340244,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-162.ec2.internal,}"
Jul 13 18:31:53.291059 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.291049    2565 policy_none.go:47] "Start"
Jul 13 18:31:53.301297 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.301094    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-162.ec2.internal.18c1ed00606228c2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-162.ec2.internal,UID:ip-10-0-131-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-162.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-162.ec2.internal,},FirstTimestamp:2026-07-13 18:31:53.288255682 +0000 UTC m=+0.375361141,LastTimestamp:2026-07-13 18:31:53.288255682 +0000 UTC m=+0.375361141,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-162.ec2.internal,}"
Jul 13 18:31:53.301297 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.301291    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x4ch5"
Jul 13 18:31:53.309361 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.309344    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x4ch5"
Jul 13 18:31:53.312516 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.312391    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-162.ec2.internal.18c1ed00606259a1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-162.ec2.internal,UID:ip-10-0-131-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-162.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-162.ec2.internal,},FirstTimestamp:2026-07-13 18:31:53.288268193 +0000 UTC m=+0.375373648,LastTimestamp:2026-07-13 18:31:53.288268193 +0000 UTC m=+0.375373648,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-162.ec2.internal,}"
Jul 13 18:31:53.335112 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.335098    2565 manager.go:337] "Starting Device Plugin manager"
Jul 13 18:31:53.341114 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.335128    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 18:31:53.341114 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.335137    2565 server.go:87] "Starting device plugin registration server"
Jul 13 18:31:53.341114 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.335387    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 18:31:53.341114 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.335400    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 18:31:53.341114 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.335491    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 18:31:53.341114 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.335562    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 18:31:53.341114 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.335571    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 18:31:53.341114 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.336057    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 18:31:53.341114 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.336101    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:53.435775 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.435719    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:31:53.436860 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.436841    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:31:53.436936 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.436884    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:31:53.436936 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.436898    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:31:53.436999 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.436939    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.449243 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.449227    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.449283 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.449248    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-162.ec2.internal\": node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:53.457446 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.457420    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 18:31:53.458895 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.458871    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 18:31:53.458977 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.458916    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 18:31:53.458977 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.458938    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 18:31:53.458977 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.458971    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 18:31:53.464212 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.464194    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:31:53.490799 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.490782    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:53.559331 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.559308    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"]
Jul 13 18:31:53.559406 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.559388    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:31:53.562978 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.562960    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:31:53.563071 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.562990    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:31:53.563071 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.563000    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:31:53.564305 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.564294    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:31:53.564432 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.564411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.564484 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.564450    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:31:53.564970 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.564957    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:31:53.565041 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.564978    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:31:53.565041 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.564993    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:31:53.565041 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.565007    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:31:53.565041 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.565031    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:31:53.565181 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.565046    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:31:53.566403 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.566388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.566455 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.566419    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:31:53.567052 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.567036    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:31:53.567134 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.567065    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:31:53.567134 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.567079    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:31:53.573576 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.573560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8443562bfc49da3cf54d3bbbbd1082e0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.ec2.internal\" (UID: \"8443562bfc49da3cf54d3bbbbd1082e0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.573661 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.573583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a337b04f9774a1e52f1fa9a00cc413f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"a337b04f9774a1e52f1fa9a00cc413f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.573661 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.573601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a337b04f9774a1e52f1fa9a00cc413f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"a337b04f9774a1e52f1fa9a00cc413f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.591085 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.591067    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:53.605097 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.605073    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-162.ec2.internal\" not found" node="ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.609431 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.609415    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-162.ec2.internal\" not found" node="ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.674185 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.674161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a337b04f9774a1e52f1fa9a00cc413f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"a337b04f9774a1e52f1fa9a00cc413f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.674318 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.674192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a337b04f9774a1e52f1fa9a00cc413f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"a337b04f9774a1e52f1fa9a00cc413f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.674318 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.674218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8443562bfc49da3cf54d3bbbbd1082e0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.ec2.internal\" (UID: \"8443562bfc49da3cf54d3bbbbd1082e0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.674318 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.674266    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8443562bfc49da3cf54d3bbbbd1082e0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.ec2.internal\" (UID: \"8443562bfc49da3cf54d3bbbbd1082e0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.674318 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.674264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a337b04f9774a1e52f1fa9a00cc413f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"a337b04f9774a1e52f1fa9a00cc413f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.674318 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.674278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a337b04f9774a1e52f1fa9a00cc413f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"a337b04f9774a1e52f1fa9a00cc413f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.691236 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.691183    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:53.791962 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.791918    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:53.892504 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.892459    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:53.907641 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.907619    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.912753 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:53.912739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:53.993045 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:53.992979    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:54.093538 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:54.093511    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:54.144690 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.144669    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:31:54.194530 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:54.194508    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:54.204673 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.204655    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 18:31:54.204774 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.204757    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 18:31:54.204820 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.204802    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 18:31:54.294810 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:54.294733    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:54.312940 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.312878    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 18:26:54 +0000 UTC" deadline="2028-03-02 00:36:36.201646732 +0000 UTC"
Jul 13 18:31:54.312940 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.312943    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14334h4m41.888713159s"
Jul 13 18:31:54.395554 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:54.395517    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:54.434275 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:54.434225    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda337b04f9774a1e52f1fa9a00cc413f8.slice/crio-f4ca06ea102b8e51cc0632fb7120497268c2a01879243e97b0f55ce2766075e9 WatchSource:0}: Error finding container f4ca06ea102b8e51cc0632fb7120497268c2a01879243e97b0f55ce2766075e9: Status 404 returned error can't find the container with id f4ca06ea102b8e51cc0632fb7120497268c2a01879243e97b0f55ce2766075e9
Jul 13 18:31:54.438692 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.438677    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 18:31:54.457169 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.457150    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:31:54.458493 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.458460    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:31:54.458571 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.458511    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:31:54.458571 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.458527    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:31:54.462665 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.462629    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal" event={"ID":"a337b04f9774a1e52f1fa9a00cc413f8","Type":"ContainerStarted","Data":"f4ca06ea102b8e51cc0632fb7120497268c2a01879243e97b0f55ce2766075e9"}
Jul 13 18:31:54.496037 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:54.495991    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:54.499264 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:54.499233    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8443562bfc49da3cf54d3bbbbd1082e0.slice/crio-04119d38072d037fce204822f2a7726ce5a3412859d860cc44cf0eebcc03dd29 WatchSource:0}: Error finding container 04119d38072d037fce204822f2a7726ce5a3412859d860cc44cf0eebcc03dd29: Status 404 returned error can't find the container with id 04119d38072d037fce204822f2a7726ce5a3412859d860cc44cf0eebcc03dd29
Jul 13 18:31:54.596933 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:54.596838    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Jul 13 18:31:54.613706 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.613687    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:31:54.669908 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.669875    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:54.683144 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.683124    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 18:31:54.684144 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.684131    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Jul 13 18:31:54.694158 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.694139    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 18:31:54.862449 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:54.862365    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:31:55.247102 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.247015    2565 apiserver.go:52] "Watching apiserver"
Jul 13 18:31:55.257291 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.257260    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 18:31:55.259716 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.259692    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal","openshift-multus/multus-5qqkl","openshift-multus/network-metrics-daemon-jmmm5","openshift-network-diagnostics/network-check-target-b5qm6","kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l","openshift-image-registry/node-ca-4f2sg","openshift-multus/multus-additional-cni-plugins-7bk9s","openshift-network-operator/iptables-alerter-2plhb","openshift-ovn-kubernetes/ovnkube-node-2g87g","kube-system/global-pull-secret-syncer-8gf7z","kube-system/konnectivity-agent-n4lzg","openshift-cluster-node-tuning-operator/tuned-2hnml","openshift-dns/node-resolver-7nm2p"]
Jul 13 18:31:55.261136 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.261113    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.262666 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.262643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:55.262773 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.262749    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:31:55.264230 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.264198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:55.264340 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.264288    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:31:55.264802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.264781    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 18:31:55.264896 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.264828    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 18:31:55.264896 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.264861    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qdhnz\""
Jul 13 18:31:55.265009 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.264790    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 18:31:55.265769 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.265747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:31:55.265848 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.265820    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:31:55.267033 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.266932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.268241 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.268218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.269711 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.269689    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.270119 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.270102    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 18:31:55.271164 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.271145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.271265 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.271174    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 18:31:55.272671 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.272646    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.274412 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.274393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.274805 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.274787    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 18:31:55.275184 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.275165    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 18:31:55.275184 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.275175    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 18:31:55.275457 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.275438    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sb9x8\""
Jul 13 18:31:55.275961 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.275944    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 18:31:55.276228 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.276208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.276502 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.276481    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 18:31:55.277760 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.277570    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 18:31:55.278124 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.278055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:31:55.279170 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.279153    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 18:31:55.279263 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.279203    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 18:31:55.279263 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.279254    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 18:31:55.279450 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.279328    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 18:31:55.279450 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.279342    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:31:55.280512 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.280492    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 18:31:55.280617 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.280527    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:31:55.280617 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.280541    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 18:31:55.280617 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.280599    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 18:31:55.283337 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283319    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 18:31:55.283561 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c58fee49-7c00-4083-ab69-fe0b779a3e5f-kubelet-config\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:55.283688 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdtxl\" (UniqueName: \"kubernetes.io/projected/a7d6e830-818a-4bd4-80d2-87ed399309df-kube-api-access-tdtxl\") pod \"node-resolver-7nm2p\" (UID: \"a7d6e830-818a-4bd4-80d2-87ed399309df\") " pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.283688 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-sys\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.283688 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d6e830-818a-4bd4-80d2-87ed399309df-tmp-dir\") pod \"node-resolver-7nm2p\" (UID: \"a7d6e830-818a-4bd4-80d2-87ed399309df\") " pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.283888 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-registration-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.283888 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-sys-fs\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.283888 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283811    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gcfsk\""
Jul 13 18:31:55.283888 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-sysconfig\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.284094 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-tmp\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.284094 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283939    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 18:31:55.284094 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.283937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9017d37-5039-4eb0-bcb5-92bdbd792deb-iptables-alerter-script\") pod \"iptables-alerter-2plhb\" (UID: \"d9017d37-5039-4eb0-bcb5-92bdbd792deb\") " pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.284094 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9017d37-5039-4eb0-bcb5-92bdbd792deb-host-slash\") pod \"iptables-alerter-2plhb\" (UID: \"d9017d37-5039-4eb0-bcb5-92bdbd792deb\") " pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.284094 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e96eecf0-f3c5-433f-ad85-222da1b718c5-host\") pod \"node-ca-4f2sg\" (UID: \"e96eecf0-f3c5-433f-ad85-222da1b718c5\") " pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.284094 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-socket-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-sysctl-d\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vddwg\" (UniqueName: \"kubernetes.io/projected/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-kube-api-access-vddwg\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e96eecf0-f3c5-433f-ad85-222da1b718c5-serviceca\") pod \"node-ca-4f2sg\" (UID: \"e96eecf0-f3c5-433f-ad85-222da1b718c5\") " pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-host\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhbg4\" (UniqueName: \"kubernetes.io/projected/e96eecf0-f3c5-433f-ad85-222da1b718c5-kube-api-access-nhbg4\") pod \"node-ca-4f2sg\" (UID: \"e96eecf0-f3c5-433f-ad85-222da1b718c5\") " pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9pvbg\""
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-sysctl-conf\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284367    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-scm8l\""
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-systemd\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bpqk\" (UniqueName: \"kubernetes.io/projected/f06e2641-6546-430d-a73d-80c68b760a45-kube-api-access-7bpqk\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.284508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-kubernetes\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzvz4\" (UniqueName: \"kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4\") pod \"network-check-target-b5qm6\" (UID: \"419152ca-c25c-48c9-9326-7f2e04e4e8aa\") " pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284548    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rcxzj\""
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7d6e830-818a-4bd4-80d2-87ed399309df-hosts-file\") pod \"node-resolver-7nm2p\" (UID: \"a7d6e830-818a-4bd4-80d2-87ed399309df\") " pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-modprobe-d\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-lib-modules\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-var-lib-kubelet\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284663    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cw29c\""
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-tuned\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j455k\" (UniqueName: \"kubernetes.io/projected/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-kube-api-access-j455k\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c58fee49-7c00-4083-ab69-fe0b779a3e5f-dbus\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-device-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-run\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.284817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzmwx\" (UniqueName: \"kubernetes.io/projected/d9017d37-5039-4eb0-bcb5-92bdbd792deb-kube-api-access-dzmwx\") pod \"iptables-alerter-2plhb\" (UID: \"d9017d37-5039-4eb0-bcb5-92bdbd792deb\") " pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.285202 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.285009    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 18:31:55.285892 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.285768    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 18:31:55.287378 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.287039    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 18:31:55.287378 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.287281    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 18:31:55.287935 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.287916    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mkd2t\""
Jul 13 18:31:55.288108 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.288094    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 18:31:55.288461 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.288411    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fb4z4\""
Jul 13 18:31:55.288643 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.288628    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 18:31:55.301514 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.301489    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 18:31:55.332173 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.332145    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cknjz"
Jul 13 18:31:55.346248 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.346222    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cknjz"
Jul 13 18:31:55.371617 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.371592    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 18:31:55.385214 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d6e830-818a-4bd4-80d2-87ed399309df-tmp-dir\") pod \"node-resolver-7nm2p\" (UID: \"a7d6e830-818a-4bd4-80d2-87ed399309df\") " pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.385404 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-registration-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.385404 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-sysconfig\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.385404 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-tmp\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.385404 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-run-openvswitch\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.385404 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-cni-bin\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.385404 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.385404 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-sysconfig\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.385404 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385393    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-registration-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.385404 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-ovn-node-metrics-cert\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e96eecf0-f3c5-433f-ad85-222da1b718c5-host\") pod \"node-ca-4f2sg\" (UID: \"e96eecf0-f3c5-433f-ad85-222da1b718c5\") " pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-socket-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e96eecf0-f3c5-433f-ad85-222da1b718c5-host\") pod \"node-ca-4f2sg\" (UID: \"e96eecf0-f3c5-433f-ad85-222da1b718c5\") " pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-ovnkube-script-lib\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d6e830-818a-4bd4-80d2-87ed399309df-tmp-dir\") pod \"node-resolver-7nm2p\" (UID: \"a7d6e830-818a-4bd4-80d2-87ed399309df\") " pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-var-lib-cni-multus\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-socket-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3effc6e2-75d5-468b-9ac9-f0f621a9b5a7-konnectivity-ca\") pod \"konnectivity-agent-n4lzg\" (UID: \"3effc6e2-75d5-468b-9ac9-f0f621a9b5a7\") " pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385689    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e96eecf0-f3c5-433f-ad85-222da1b718c5-serviceca\") pod \"node-ca-4f2sg\" (UID: \"e96eecf0-f3c5-433f-ad85-222da1b718c5\") " pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-os-release\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-sysctl-conf\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.385907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bpqk\" (UniqueName: \"kubernetes.io/projected/f06e2641-6546-430d-a73d-80c68b760a45-kube-api-access-7bpqk\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvz4\" (UniqueName: \"kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4\") pod \"network-check-target-b5qm6\" (UID: \"419152ca-c25c-48c9-9326-7f2e04e4e8aa\") " pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-run-netns\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-run-systemd\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-etc-openvswitch\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385901    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvphj\" (UniqueName: \"kubernetes.io/projected/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-kube-api-access-rvphj\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-multus-conf-dir\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-sysctl-conf\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7d6e830-818a-4bd4-80d2-87ed399309df-hosts-file\") pod \"node-resolver-7nm2p\" (UID: \"a7d6e830-818a-4bd4-80d2-87ed399309df\") " pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.385972    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.386095    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret podName:c58fee49-7c00-4083-ab69-fe0b779a3e5f nodeName:}" failed. No retries permitted until 2026-07-13 18:31:55.886048972 +0000 UTC m=+2.973154432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret") pod "global-pull-secret-syncer-8gf7z" (UID: "c58fee49-7c00-4083-ab69-fe0b779a3e5f") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-modprobe-d\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.385978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-modprobe-d\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-var-lib-kubelet\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j455k\" (UniqueName: \"kubernetes.io/projected/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-kube-api-access-j455k\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7d6e830-818a-4bd4-80d2-87ed399309df-hosts-file\") pod \"node-resolver-7nm2p\" (UID: \"a7d6e830-818a-4bd4-80d2-87ed399309df\") " pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-log-socket\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.386869 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-var-lib-kubelet\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386247    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e96eecf0-f3c5-433f-ad85-222da1b718c5-serviceca\") pod \"node-ca-4f2sg\" (UID: \"e96eecf0-f3c5-433f-ad85-222da1b718c5\") " pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-var-lib-cni-bin\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-etc-kubernetes\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-device-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-run\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-ovnkube-config\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-device-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-run\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be6726ef-f078-4798-9638-6d710a53c037-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-run-netns\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-var-lib-kubelet\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c58fee49-7c00-4083-ab69-fe0b779a3e5f-kubelet-config\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-sys\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386738    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c58fee49-7c00-4083-ab69-fe0b779a3e5f-kubelet-config\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-var-lib-openvswitch\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.387634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-node-log\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-sys\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-cni-netd\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be6726ef-f078-4798-9638-6d710a53c037-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-os-release\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-run-k8s-cni-cncf-io\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-sys-fs\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-sys-fs\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.386981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9017d37-5039-4eb0-bcb5-92bdbd792deb-iptables-alerter-script\") pod \"iptables-alerter-2plhb\" (UID: \"d9017d37-5039-4eb0-bcb5-92bdbd792deb\") " pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9017d37-5039-4eb0-bcb5-92bdbd792deb-host-slash\") pod \"iptables-alerter-2plhb\" (UID: \"d9017d37-5039-4eb0-bcb5-92bdbd792deb\") " pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-env-overrides\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-cnibin\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9017d37-5039-4eb0-bcb5-92bdbd792deb-host-slash\") pod \"iptables-alerter-2plhb\" (UID: \"d9017d37-5039-4eb0-bcb5-92bdbd792deb\") " pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-cnibin\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-run-multus-certs\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-sysctl-d\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vddwg\" (UniqueName: \"kubernetes.io/projected/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-kube-api-access-vddwg\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:55.388439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-multus-cni-dir\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-hostroot\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-host\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be6726ef-f078-4798-9638-6d710a53c037-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-sysctl-d\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhbg4\" (UniqueName: \"kubernetes.io/projected/e96eecf0-f3c5-433f-ad85-222da1b718c5-kube-api-access-nhbg4\") pod \"node-ca-4f2sg\" (UID: \"e96eecf0-f3c5-433f-ad85-222da1b718c5\") " pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f06e2641-6546-430d-a73d-80c68b760a45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-host\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-systemd\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-systemd\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-run-ovn\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-kubernetes\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.387504    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-slash\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.387553    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs podName:b3e8e599-4106-42f0-97f1-a35fdf7afc9c nodeName:}" failed. No retries permitted until 2026-07-13 18:31:55.887535958 +0000 UTC m=+2.974641413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs") pod "network-metrics-daemon-jmmm5" (UID: "b3e8e599-4106-42f0-97f1-a35fdf7afc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:31:55.389216 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9017d37-5039-4eb0-bcb5-92bdbd792deb-iptables-alerter-script\") pod \"iptables-alerter-2plhb\" (UID: \"d9017d37-5039-4eb0-bcb5-92bdbd792deb\") " pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn696\" (UniqueName: \"kubernetes.io/projected/be6726ef-f078-4798-9638-6d710a53c037-kube-api-access-hn696\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-kubernetes\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-lib-modules\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-tuned\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c58fee49-7c00-4083-ab69-fe0b779a3e5f-dbus\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzmwx\" (UniqueName: \"kubernetes.io/projected/d9017d37-5039-4eb0-bcb5-92bdbd792deb-kube-api-access-dzmwx\") pod \"iptables-alerter-2plhb\" (UID: \"d9017d37-5039-4eb0-bcb5-92bdbd792deb\") " pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-lib-modules\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-systemd-units\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21012000-8edd-4826-a3f2-6717605250e9-cni-binary-copy\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-multus-socket-dir-parent\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c58fee49-7c00-4083-ab69-fe0b779a3e5f-dbus\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7t6d\" (UniqueName: \"kubernetes.io/projected/21012000-8edd-4826-a3f2-6717605250e9-kube-api-access-d7t6d\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdtxl\" (UniqueName: \"kubernetes.io/projected/a7d6e830-818a-4bd4-80d2-87ed399309df-kube-api-access-tdtxl\") pod \"node-resolver-7nm2p\" (UID: \"a7d6e830-818a-4bd4-80d2-87ed399309df\") " pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-kubelet\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-system-cni-dir\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-system-cni-dir\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.390014 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.387964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21012000-8edd-4826-a3f2-6717605250e9-multus-daemon-config\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.390802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.388023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3effc6e2-75d5-468b-9ac9-f0f621a9b5a7-agent-certs\") pod \"konnectivity-agent-n4lzg\" (UID: \"3effc6e2-75d5-468b-9ac9-f0f621a9b5a7\") " pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:31:55.390802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.389480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-tmp\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.390802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.390097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-etc-tuned\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.407698 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.407669    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:31:55.407786 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.407703    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:31:55.407786 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.407718    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vzvz4 for pod openshift-network-diagnostics/network-check-target-b5qm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:31:55.407869 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.407791    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4 podName:419152ca-c25c-48c9-9326-7f2e04e4e8aa nodeName:}" failed. No retries permitted until 2026-07-13 18:31:55.907775894 +0000 UTC m=+2.994881361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vzvz4" (UniqueName: "kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4") pod "network-check-target-b5qm6" (UID: "419152ca-c25c-48c9-9326-7f2e04e4e8aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:31:55.408299 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.408266    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzmwx\" (UniqueName: \"kubernetes.io/projected/d9017d37-5039-4eb0-bcb5-92bdbd792deb-kube-api-access-dzmwx\") pod \"iptables-alerter-2plhb\" (UID: \"d9017d37-5039-4eb0-bcb5-92bdbd792deb\") " pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.409060 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.409033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bpqk\" (UniqueName: \"kubernetes.io/projected/f06e2641-6546-430d-a73d-80c68b760a45-kube-api-access-7bpqk\") pod \"aws-ebs-csi-driver-node-9jm9l\" (UID: \"f06e2641-6546-430d-a73d-80c68b760a45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.409204 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.409185    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j455k\" (UniqueName: \"kubernetes.io/projected/b4b3f0c8-ed78-4e65-a6c8-0c46431922d7-kube-api-access-j455k\") pod \"tuned-2hnml\" (UID: \"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7\") " pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.409269 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.409248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhbg4\" (UniqueName: \"kubernetes.io/projected/e96eecf0-f3c5-433f-ad85-222da1b718c5-kube-api-access-nhbg4\") pod \"node-ca-4f2sg\" (UID: \"e96eecf0-f3c5-433f-ad85-222da1b718c5\") " pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.415686 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.415668    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vddwg\" (UniqueName: \"kubernetes.io/projected/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-kube-api-access-vddwg\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:55.417855 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.417839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdtxl\" (UniqueName: \"kubernetes.io/projected/a7d6e830-818a-4bd4-80d2-87ed399309df-kube-api-access-tdtxl\") pod \"node-resolver-7nm2p\" (UID: \"a7d6e830-818a-4bd4-80d2-87ed399309df\") " pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.466115 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.466079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal" event={"ID":"8443562bfc49da3cf54d3bbbbd1082e0","Type":"ContainerStarted","Data":"04119d38072d037fce204822f2a7726ce5a3412859d860cc44cf0eebcc03dd29"}
Jul 13 18:31:55.489318 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-multus-conf-dir\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-log-socket\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-var-lib-cni-bin\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-etc-kubernetes\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-multus-conf-dir\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-log-socket\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-ovnkube-config\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-etc-kubernetes\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489493    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-var-lib-cni-bin\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.489521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be6726ef-f078-4798-9638-6d710a53c037-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-run-netns\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-var-lib-kubelet\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-var-lib-openvswitch\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-node-log\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489634    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-run-netns\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-cni-netd\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-var-lib-kubelet\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-node-log\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be6726ef-f078-4798-9638-6d710a53c037-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-cni-netd\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-var-lib-openvswitch\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-os-release\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-run-k8s-cni-cncf-io\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-env-overrides\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-cnibin\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-run-k8s-cni-cncf-io\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489818    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-os-release\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.490118 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-cnibin\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-cnibin\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.489870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-cnibin\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-run-multus-certs\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-multus-cni-dir\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-hostroot\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be6726ef-f078-4798-9638-6d710a53c037-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be6726ef-f078-4798-9638-6d710a53c037-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-run-ovn\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be6726ef-f078-4798-9638-6d710a53c037-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-slash\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-slash\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-run-ovn\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn696\" (UniqueName: \"kubernetes.io/projected/be6726ef-f078-4798-9638-6d710a53c037-kube-api-access-hn696\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-run-multus-certs\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-systemd-units\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-multus-cni-dir\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490281    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-hostroot\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491016 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21012000-8edd-4826-a3f2-6717605250e9-cni-binary-copy\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-env-overrides\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-multus-socket-dir-parent\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7t6d\" (UniqueName: \"kubernetes.io/projected/21012000-8edd-4826-a3f2-6717605250e9-kube-api-access-d7t6d\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-kubelet\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-systemd-units\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-system-cni-dir\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-system-cni-dir\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21012000-8edd-4826-a3f2-6717605250e9-multus-daemon-config\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-multus-socket-dir-parent\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3effc6e2-75d5-468b-9ac9-f0f621a9b5a7-agent-certs\") pod \"konnectivity-agent-n4lzg\" (UID: \"3effc6e2-75d5-468b-9ac9-f0f621a9b5a7\") " pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-run-openvswitch\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-cni-bin\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-ovn-node-metrics-cert\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-ovnkube-script-lib\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.491911 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-var-lib-cni-multus\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3effc6e2-75d5-468b-9ac9-f0f621a9b5a7-konnectivity-ca\") pod \"konnectivity-agent-n4lzg\" (UID: \"3effc6e2-75d5-468b-9ac9-f0f621a9b5a7\") " pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-kubelet\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-os-release\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-system-cni-dir\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490703    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490725    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-run-netns\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-run-openvswitch\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-ovnkube-config\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-host-var-lib-cni-multus\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-run-systemd\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be6726ef-f078-4798-9638-6d710a53c037-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-cni-bin\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490914    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-host-run-netns\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.490749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-run-systemd\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.491370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-etc-openvswitch\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.491424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvphj\" (UniqueName: \"kubernetes.io/projected/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-kube-api-access-rvphj\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.492458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.491502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.493032 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.491572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21012000-8edd-4826-a3f2-6717605250e9-cni-binary-copy\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.493032 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.491631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21012000-8edd-4826-a3f2-6717605250e9-system-cni-dir\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.493032 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.491669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21012000-8edd-4826-a3f2-6717605250e9-multus-daemon-config\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.493032 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.491692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-ovnkube-script-lib\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.493032 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.491924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be6726ef-f078-4798-9638-6d710a53c037-os-release\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.493032 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.491980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-etc-openvswitch\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.493032 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.492406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3effc6e2-75d5-468b-9ac9-f0f621a9b5a7-konnectivity-ca\") pod \"konnectivity-agent-n4lzg\" (UID: \"3effc6e2-75d5-468b-9ac9-f0f621a9b5a7\") " pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:31:55.496548 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.496522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3effc6e2-75d5-468b-9ac9-f0f621a9b5a7-agent-certs\") pod \"konnectivity-agent-n4lzg\" (UID: \"3effc6e2-75d5-468b-9ac9-f0f621a9b5a7\") " pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:31:55.497870 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.497809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-ovn-node-metrics-cert\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.507440 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.507034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn696\" (UniqueName: \"kubernetes.io/projected/be6726ef-f078-4798-9638-6d710a53c037-kube-api-access-hn696\") pod \"multus-additional-cni-plugins-7bk9s\" (UID: \"be6726ef-f078-4798-9638-6d710a53c037\") " pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.507440 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.507374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvphj\" (UniqueName: \"kubernetes.io/projected/8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f-kube-api-access-rvphj\") pod \"ovnkube-node-2g87g\" (UID: \"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.507440 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.507399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7t6d\" (UniqueName: \"kubernetes.io/projected/21012000-8edd-4826-a3f2-6717605250e9-kube-api-access-d7t6d\") pod \"multus-5qqkl\" (UID: \"21012000-8edd-4826-a3f2-6717605250e9\") " pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.560211 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.560181    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:31:55.574069 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.574034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4f2sg"
Jul 13 18:31:55.581957 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.581937    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7nm2p"
Jul 13 18:31:55.583487 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:55.583440    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96eecf0_f3c5_433f_ad85_222da1b718c5.slice/crio-94cfd99c73e44ef2fc949cf4b654c6af4561203e2a7017dd760d6b2c6c57d6c6 WatchSource:0}: Error finding container 94cfd99c73e44ef2fc949cf4b654c6af4561203e2a7017dd760d6b2c6c57d6c6: Status 404 returned error can't find the container with id 94cfd99c73e44ef2fc949cf4b654c6af4561203e2a7017dd760d6b2c6c57d6c6
Jul 13 18:31:55.590569 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.590534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l"
Jul 13 18:31:55.592116 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:55.592092    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d6e830_818a_4bd4_80d2_87ed399309df.slice/crio-081f8bf5e05ab9ccf3be2646692ddef59b352615922afa267357be742acb940c WatchSource:0}: Error finding container 081f8bf5e05ab9ccf3be2646692ddef59b352615922afa267357be742acb940c: Status 404 returned error can't find the container with id 081f8bf5e05ab9ccf3be2646692ddef59b352615922afa267357be742acb940c
Jul 13 18:31:55.599016 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:55.598991    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06e2641_6546_430d_a73d_80c68b760a45.slice/crio-704dfcd5295d5c466c16bcb225a65cf1054961f7353adf8018849168abd3eb9a WatchSource:0}: Error finding container 704dfcd5295d5c466c16bcb225a65cf1054961f7353adf8018849168abd3eb9a: Status 404 returned error can't find the container with id 704dfcd5295d5c466c16bcb225a65cf1054961f7353adf8018849168abd3eb9a
Jul 13 18:31:55.599626 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.599604    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2plhb"
Jul 13 18:31:55.605856 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.605838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hnml"
Jul 13 18:31:55.609458 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:55.609438    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9017d37_5039_4eb0_bcb5_92bdbd792deb.slice/crio-4a1a40a5cee407c19f050fbdfc8146fed126fc0a5f1fac36e71ec012a4c38979 WatchSource:0}: Error finding container 4a1a40a5cee407c19f050fbdfc8146fed126fc0a5f1fac36e71ec012a4c38979: Status 404 returned error can't find the container with id 4a1a40a5cee407c19f050fbdfc8146fed126fc0a5f1fac36e71ec012a4c38979
Jul 13 18:31:55.613653 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.613579    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5qqkl"
Jul 13 18:31:55.615420 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:55.615360    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b3f0c8_ed78_4e65_a6c8_0c46431922d7.slice/crio-4e4d743c4895f297b5bd299235b0ed686bb3dfb78529afe3d52dd13ac162ea02 WatchSource:0}: Error finding container 4e4d743c4895f297b5bd299235b0ed686bb3dfb78529afe3d52dd13ac162ea02: Status 404 returned error can't find the container with id 4e4d743c4895f297b5bd299235b0ed686bb3dfb78529afe3d52dd13ac162ea02
Jul 13 18:31:55.621970 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.621936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:31:55.622053 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:55.621939    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21012000_8edd_4826_a3f2_6717605250e9.slice/crio-0e4fe1caa564b3f7f49c92097818ac22290e0470cf69badf683b8bcf97c3e74e WatchSource:0}: Error finding container 0e4fe1caa564b3f7f49c92097818ac22290e0470cf69badf683b8bcf97c3e74e: Status 404 returned error can't find the container with id 0e4fe1caa564b3f7f49c92097818ac22290e0470cf69badf683b8bcf97c3e74e
Jul 13 18:31:55.629392 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.629371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7bk9s"
Jul 13 18:31:55.630856 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:55.630594    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e77e4a1_54ab_4c49_9460_8f5fa06f2b5f.slice/crio-cf62fab55d4f9214603f7668e22fc3b872a4ac65c337ec966240551a3a3885ac WatchSource:0}: Error finding container cf62fab55d4f9214603f7668e22fc3b872a4ac65c337ec966240551a3a3885ac: Status 404 returned error can't find the container with id cf62fab55d4f9214603f7668e22fc3b872a4ac65c337ec966240551a3a3885ac
Jul 13 18:31:55.635238 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.635218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:31:55.638932 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:55.638895    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6726ef_f078_4798_9638_6d710a53c037.slice/crio-3da932a38d9d78db111589b06f6b9a7845e8b7190273178029d0003cc0d3604b WatchSource:0}: Error finding container 3da932a38d9d78db111589b06f6b9a7845e8b7190273178029d0003cc0d3604b: Status 404 returned error can't find the container with id 3da932a38d9d78db111589b06f6b9a7845e8b7190273178029d0003cc0d3604b
Jul 13 18:31:55.644665 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:31:55.644629    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3effc6e2_75d5_468b_9ac9_f0f621a9b5a7.slice/crio-b899b368320d063415fdd3829b128762e4111ec6954817cc4d911ac545c363ee WatchSource:0}: Error finding container b899b368320d063415fdd3829b128762e4111ec6954817cc4d911ac545c363ee: Status 404 returned error can't find the container with id b899b368320d063415fdd3829b128762e4111ec6954817cc4d911ac545c363ee
Jul 13 18:31:55.895674 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.895584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:55.895674 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.895650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:55.895871 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.895773    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:31:55.895871 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.895776    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:31:55.895871 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.895840    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret podName:c58fee49-7c00-4083-ab69-fe0b779a3e5f nodeName:}" failed. No retries permitted until 2026-07-13 18:31:56.895822715 +0000 UTC m=+3.982928171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret") pod "global-pull-secret-syncer-8gf7z" (UID: "c58fee49-7c00-4083-ab69-fe0b779a3e5f") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:31:55.895871 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.895855    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs podName:b3e8e599-4106-42f0-97f1-a35fdf7afc9c nodeName:}" failed. No retries permitted until 2026-07-13 18:31:56.895848728 +0000 UTC m=+3.982954172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs") pod "network-metrics-daemon-jmmm5" (UID: "b3e8e599-4106-42f0-97f1-a35fdf7afc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:31:55.920277 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.920251    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:31:55.997041 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:55.997008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvz4\" (UniqueName: \"kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4\") pod \"network-check-target-b5qm6\" (UID: \"419152ca-c25c-48c9-9326-7f2e04e4e8aa\") " pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:31:55.997215 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.997150    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:31:55.997215 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.997171    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:31:55.997215 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.997180    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vzvz4 for pod openshift-network-diagnostics/network-check-target-b5qm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:31:55.997319 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:55.997239    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4 podName:419152ca-c25c-48c9-9326-7f2e04e4e8aa nodeName:}" failed. No retries permitted until 2026-07-13 18:31:56.997222163 +0000 UTC m=+4.084327629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzvz4" (UniqueName: "kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4") pod "network-check-target-b5qm6" (UID: "419152ca-c25c-48c9-9326-7f2e04e4e8aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:31:56.349539 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.349378    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 18:26:56 +0000 UTC" deadline="2028-04-06 00:20:31.749045158 +0000 UTC"
Jul 13 18:31:56.349539 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.349419    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15173h48m35.399632205s"
Jul 13 18:31:56.460001 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.459251    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:56.460001 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:56.459389    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:31:56.460001 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.459840    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:31:56.460001 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:56.459939    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:31:56.472910 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.472808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5qqkl" event={"ID":"21012000-8edd-4826-a3f2-6717605250e9","Type":"ContainerStarted","Data":"0e4fe1caa564b3f7f49c92097818ac22290e0470cf69badf683b8bcf97c3e74e"}
Jul 13 18:31:56.480648 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.480611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7nm2p" event={"ID":"a7d6e830-818a-4bd4-80d2-87ed399309df","Type":"ContainerStarted","Data":"081f8bf5e05ab9ccf3be2646692ddef59b352615922afa267357be742acb940c"}
Jul 13 18:31:56.483772 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.483738    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4f2sg" event={"ID":"e96eecf0-f3c5-433f-ad85-222da1b718c5","Type":"ContainerStarted","Data":"94cfd99c73e44ef2fc949cf4b654c6af4561203e2a7017dd760d6b2c6c57d6c6"}
Jul 13 18:31:56.487023 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.486993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n4lzg" event={"ID":"3effc6e2-75d5-468b-9ac9-f0f621a9b5a7","Type":"ContainerStarted","Data":"b899b368320d063415fdd3829b128762e4111ec6954817cc4d911ac545c363ee"}
Jul 13 18:31:56.500113 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.500081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" event={"ID":"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f","Type":"ContainerStarted","Data":"cf62fab55d4f9214603f7668e22fc3b872a4ac65c337ec966240551a3a3885ac"}
Jul 13 18:31:56.503022 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.502996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hnml" event={"ID":"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7","Type":"ContainerStarted","Data":"4e4d743c4895f297b5bd299235b0ed686bb3dfb78529afe3d52dd13ac162ea02"}
Jul 13 18:31:56.506110 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.506029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2plhb" event={"ID":"d9017d37-5039-4eb0-bcb5-92bdbd792deb","Type":"ContainerStarted","Data":"4a1a40a5cee407c19f050fbdfc8146fed126fc0a5f1fac36e71ec012a4c38979"}
Jul 13 18:31:56.519536 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.519460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l" event={"ID":"f06e2641-6546-430d-a73d-80c68b760a45","Type":"ContainerStarted","Data":"704dfcd5295d5c466c16bcb225a65cf1054961f7353adf8018849168abd3eb9a"}
Jul 13 18:31:56.523226 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.523160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bk9s" event={"ID":"be6726ef-f078-4798-9638-6d710a53c037","Type":"ContainerStarted","Data":"3da932a38d9d78db111589b06f6b9a7845e8b7190273178029d0003cc0d3604b"}
Jul 13 18:31:56.907554 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.907513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:56.907743 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:56.907618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:56.907822 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:56.907745    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:31:56.907822 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:56.907817    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs podName:b3e8e599-4106-42f0-97f1-a35fdf7afc9c nodeName:}" failed. No retries permitted until 2026-07-13 18:31:58.907795453 +0000 UTC m=+5.994900898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs") pod "network-metrics-daemon-jmmm5" (UID: "b3e8e599-4106-42f0-97f1-a35fdf7afc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:31:56.908275 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:56.908252    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:31:56.908367 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:56.908313    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret podName:c58fee49-7c00-4083-ab69-fe0b779a3e5f nodeName:}" failed. No retries permitted until 2026-07-13 18:31:58.908296985 +0000 UTC m=+5.995402433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret") pod "global-pull-secret-syncer-8gf7z" (UID: "c58fee49-7c00-4083-ab69-fe0b779a3e5f") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:31:57.008710 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:57.008656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvz4\" (UniqueName: \"kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4\") pod \"network-check-target-b5qm6\" (UID: \"419152ca-c25c-48c9-9326-7f2e04e4e8aa\") " pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:31:57.008908 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:57.008868    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:31:57.008908 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:57.008889    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:31:57.008908 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:57.008901    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vzvz4 for pod openshift-network-diagnostics/network-check-target-b5qm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:31:57.009082 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:57.008966    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4 podName:419152ca-c25c-48c9-9326-7f2e04e4e8aa nodeName:}" failed. No retries permitted until 2026-07-13 18:31:59.008944719 +0000 UTC m=+6.096050171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzvz4" (UniqueName: "kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4") pod "network-check-target-b5qm6" (UID: "419152ca-c25c-48c9-9326-7f2e04e4e8aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:31:57.350683 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:57.350601    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 18:26:56 +0000 UTC" deadline="2028-01-11 16:05:17.410640318 +0000 UTC"
Jul 13 18:31:57.350683 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:57.350676    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13125h33m20.059968713s"
Jul 13 18:31:57.461345 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:57.460751    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:57.461345 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:57.460918    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:31:58.460967 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:58.460214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:58.460967 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:58.460367    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:31:58.460967 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:58.460456    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:31:58.460967 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:58.460560    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:31:58.927900 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:58.927825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:58.928038 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:58.927909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:31:58.928103 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:58.928085    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:31:58.928170 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:58.928157    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret podName:c58fee49-7c00-4083-ab69-fe0b779a3e5f nodeName:}" failed. No retries permitted until 2026-07-13 18:32:02.928138482 +0000 UTC m=+10.015243943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret") pod "global-pull-secret-syncer-8gf7z" (UID: "c58fee49-7c00-4083-ab69-fe0b779a3e5f") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:31:58.928643 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:58.928610    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:31:58.928741 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:58.928673    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs podName:b3e8e599-4106-42f0-97f1-a35fdf7afc9c nodeName:}" failed. No retries permitted until 2026-07-13 18:32:02.92865541 +0000 UTC m=+10.015760866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs") pod "network-metrics-daemon-jmmm5" (UID: "b3e8e599-4106-42f0-97f1-a35fdf7afc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:31:59.028840 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:59.028800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvz4\" (UniqueName: \"kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4\") pod \"network-check-target-b5qm6\" (UID: \"419152ca-c25c-48c9-9326-7f2e04e4e8aa\") " pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:31:59.029043 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:59.029017    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:31:59.029121 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:59.029045    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:31:59.029121 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:59.029059    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vzvz4 for pod openshift-network-diagnostics/network-check-target-b5qm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:31:59.029228 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:59.029122    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4 podName:419152ca-c25c-48c9-9326-7f2e04e4e8aa nodeName:}" failed. No retries permitted until 2026-07-13 18:32:03.029102631 +0000 UTC m=+10.116208079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzvz4" (UniqueName: "kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4") pod "network-check-target-b5qm6" (UID: "419152ca-c25c-48c9-9326-7f2e04e4e8aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:31:59.461823 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:31:59.461788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:31:59.462298 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:31:59.461924    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:00.459314 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:00.459277    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:00.459525 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:00.459403    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:00.459978 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:00.459811    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:00.459978 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:00.459929    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:01.461695 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:01.461661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:01.462192 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:01.461815    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:02.460597 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:02.459933    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:02.460597 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:02.460062    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:02.460597 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:02.460372    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:02.460876 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:02.460456    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:02.967084 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:02.967046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:02.967603 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:02.967126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:02.967603 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:02.967271    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:32:02.967603 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:02.967335    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret podName:c58fee49-7c00-4083-ab69-fe0b779a3e5f nodeName:}" failed. No retries permitted until 2026-07-13 18:32:10.96731492 +0000 UTC m=+18.054420377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret") pod "global-pull-secret-syncer-8gf7z" (UID: "c58fee49-7c00-4083-ab69-fe0b779a3e5f") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:32:02.967797 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:02.967769    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:32:02.967850 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:02.967820    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs podName:b3e8e599-4106-42f0-97f1-a35fdf7afc9c nodeName:}" failed. No retries permitted until 2026-07-13 18:32:10.967803854 +0000 UTC m=+18.054909302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs") pod "network-metrics-daemon-jmmm5" (UID: "b3e8e599-4106-42f0-97f1-a35fdf7afc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:32:03.067886 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:03.067843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvz4\" (UniqueName: \"kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4\") pod \"network-check-target-b5qm6\" (UID: \"419152ca-c25c-48c9-9326-7f2e04e4e8aa\") " pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:03.068078 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:03.068053    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:32:03.068078 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:03.068075    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:32:03.068215 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:03.068085    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vzvz4 for pod openshift-network-diagnostics/network-check-target-b5qm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:32:03.068215 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:03.068138    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4 podName:419152ca-c25c-48c9-9326-7f2e04e4e8aa nodeName:}" failed. No retries permitted until 2026-07-13 18:32:11.06811891 +0000 UTC m=+18.155224358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzvz4" (UniqueName: "kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4") pod "network-check-target-b5qm6" (UID: "419152ca-c25c-48c9-9326-7f2e04e4e8aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:32:03.464462 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:03.463934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:03.464462 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:03.464062    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:04.459283 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:04.459240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:04.459760 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:04.459382    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:04.459831 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:04.459801    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:04.459907 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:04.459874    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:05.464035 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:05.464002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:05.464548 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:05.464163    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:06.459654 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:06.459620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:06.459835 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:06.459747    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:06.460062 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:06.459620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:06.460191 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:06.460171    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:07.462353 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:07.462319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:07.462739 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:07.462446    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:08.459316 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:08.459283    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:08.459316 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:08.459329    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:08.459602 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:08.459428    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:08.459602 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:08.459575    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:09.460263 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:09.460221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:09.460730 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:09.460369    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:10.459719 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:10.459672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:10.459904 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:10.459674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:10.459904 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:10.459812    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:10.460018 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:10.459947    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:11.031910 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:11.031867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:11.032338 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:11.031940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:11.032338 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:11.032055    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:32:11.032338 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:11.032065    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:32:11.032338 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:11.032121    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret podName:c58fee49-7c00-4083-ab69-fe0b779a3e5f nodeName:}" failed. No retries permitted until 2026-07-13 18:32:27.03210226 +0000 UTC m=+34.119207721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret") pod "global-pull-secret-syncer-8gf7z" (UID: "c58fee49-7c00-4083-ab69-fe0b779a3e5f") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:32:11.032338 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:11.032141    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs podName:b3e8e599-4106-42f0-97f1-a35fdf7afc9c nodeName:}" failed. No retries permitted until 2026-07-13 18:32:27.032130439 +0000 UTC m=+34.119235885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs") pod "network-metrics-daemon-jmmm5" (UID: "b3e8e599-4106-42f0-97f1-a35fdf7afc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:32:11.132482 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:11.132435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvz4\" (UniqueName: \"kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4\") pod \"network-check-target-b5qm6\" (UID: \"419152ca-c25c-48c9-9326-7f2e04e4e8aa\") " pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:11.132628 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:11.132603    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:32:11.132628 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:11.132625    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:32:11.132707 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:11.132636    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vzvz4 for pod openshift-network-diagnostics/network-check-target-b5qm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:32:11.132707 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:11.132691    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4 podName:419152ca-c25c-48c9-9326-7f2e04e4e8aa nodeName:}" failed. No retries permitted until 2026-07-13 18:32:27.13267353 +0000 UTC m=+34.219778974 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzvz4" (UniqueName: "kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4") pod "network-check-target-b5qm6" (UID: "419152ca-c25c-48c9-9326-7f2e04e4e8aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:32:11.459619 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:11.459580    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:11.459806 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:11.459748    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:12.459716 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:12.459675    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:12.460142 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:12.459732    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:12.460142 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:12.459818    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:12.460142 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:12.459916    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:13.461037 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:13.460998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:13.461442 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:13.461135    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:14.459340 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:14.459306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:14.459515 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:14.459424    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:14.459515 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:14.459460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:14.459633 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:14.459558    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:15.459357 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:15.459325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:15.459870 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:15.459494    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:16.459315 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:16.459282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:16.459554 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:16.459288    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:16.459554 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:16.459391    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:16.459554 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:16.459453    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:17.459958 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.459649    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:17.460612 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:17.460038    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:17.603892 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.603855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal" event={"ID":"8443562bfc49da3cf54d3bbbbd1082e0","Type":"ContainerStarted","Data":"9705ed894059f10b4879b6020121db200dc1eeec128aad6a2f90a6cc274e62a7"}
Jul 13 18:32:17.605255 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.605231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n4lzg" event={"ID":"3effc6e2-75d5-468b-9ac9-f0f621a9b5a7","Type":"ContainerStarted","Data":"4ecdc1ab42f9a507363a18e80d36cb51490ea630072c0b468cd500727b566a55"}
Jul 13 18:32:17.608065 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.608046    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:32:17.608388 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.608366    2565 generic.go:356] "Generic (PLEG): container finished" podID="8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f" containerID="5fe673251bdbe33d1538b78494722bdd92381b7e054433a154aa9bc2d2b1a710" exitCode=1
Jul 13 18:32:17.608489 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.608420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" event={"ID":"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f","Type":"ContainerStarted","Data":"e61a48e4f6406a2c2f0f95653b87659dd1a8b0d70168c303ebf17d3cacf2d512"}
Jul 13 18:32:17.608539 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.608515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" event={"ID":"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f","Type":"ContainerStarted","Data":"1f71abc45de0300bf688bb26596480e504cf21b628718b19c0d83a14e3c4471c"}
Jul 13 18:32:17.608588 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.608571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" event={"ID":"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f","Type":"ContainerStarted","Data":"9a62aaaa6bce1be20758add05d47f7fa1e469fdd396b3744c7748d6d24614026"}
Jul 13 18:32:17.608634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.608619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" event={"ID":"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f","Type":"ContainerStarted","Data":"f6c94e9fe94bfe66a6d307b6fac18cc4c3cacf71e7187674f0341ee28f0b9234"}
Jul 13 18:32:17.608683 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.608659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" event={"ID":"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f","Type":"ContainerDied","Data":"5fe673251bdbe33d1538b78494722bdd92381b7e054433a154aa9bc2d2b1a710"}
Jul 13 18:32:17.608730 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.608705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" event={"ID":"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f","Type":"ContainerStarted","Data":"79d2a97eee6bed05143968cbc6059b10998dae400a62225903646a290db1fad3"}
Jul 13 18:32:17.609744 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.609725    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hnml" event={"ID":"b4b3f0c8-ed78-4e65-a6c8-0c46431922d7","Type":"ContainerStarted","Data":"ca1b19cb2b5c32a593ce114bbe8b94372a08d20e1f0f316bdd4c0e2f9080dcf8"}
Jul 13 18:32:17.611055 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.611037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l" event={"ID":"f06e2641-6546-430d-a73d-80c68b760a45","Type":"ContainerStarted","Data":"dd7585787ece9db1120a391f37a6bc46355da34588e423d83224a7e2864335eb"}
Jul 13 18:32:17.612420 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.612402    2565 generic.go:356] "Generic (PLEG): container finished" podID="a337b04f9774a1e52f1fa9a00cc413f8" containerID="6c5b09c9a814e04bf9339ea8caa7c1680c48d0bbe989489e563f28c8df9c8625" exitCode=0
Jul 13 18:32:17.612524 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.612484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal" event={"ID":"a337b04f9774a1e52f1fa9a00cc413f8","Type":"ContainerDied","Data":"6c5b09c9a814e04bf9339ea8caa7c1680c48d0bbe989489e563f28c8df9c8625"}
Jul 13 18:32:17.613922 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.613902    2565 generic.go:356] "Generic (PLEG): container finished" podID="be6726ef-f078-4798-9638-6d710a53c037" containerID="abea3259fcf3fb4f9de65b6a5255caf6b2fc8a72fc25b5fcf2013dae37793c91" exitCode=0
Jul 13 18:32:17.614006 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.613969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bk9s" event={"ID":"be6726ef-f078-4798-9638-6d710a53c037","Type":"ContainerDied","Data":"abea3259fcf3fb4f9de65b6a5255caf6b2fc8a72fc25b5fcf2013dae37793c91"}
Jul 13 18:32:17.615388 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.615342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5qqkl" event={"ID":"21012000-8edd-4826-a3f2-6717605250e9","Type":"ContainerStarted","Data":"b0109e9ed261463b0b62b70ce1b38c9eeea2a1763e038825070e73c803c42abb"}
Jul 13 18:32:17.616547 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.616529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7nm2p" event={"ID":"a7d6e830-818a-4bd4-80d2-87ed399309df","Type":"ContainerStarted","Data":"f2ee3cc6b9f135f7d3d4e495eb423a19c7d3fee502befa66c59179138e257a24"}
Jul 13 18:32:17.624927 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.624906    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4f2sg" event={"ID":"e96eecf0-f3c5-433f-ad85-222da1b718c5","Type":"ContainerStarted","Data":"203e21d5ea08c781d2d353928db2e150189785f2a796b05ca37e900eb3c0941c"}
Jul 13 18:32:17.634660 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.634616    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n4lzg" podStartSLOduration=2.78648975 podStartE2EDuration="23.634604558s" totalImagesPullingTime="20.848114808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:17.634277667 +0000 UTC m=+24.721383163" watchObservedRunningTime="2026-07-13 18:32:17.634604558 +0000 UTC m=+24.721710022"
Jul 13 18:32:17.634919 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.634901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal" podStartSLOduration=22.634896194 podStartE2EDuration="22.634896194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:17.619886926 +0000 UTC m=+24.706992389" watchObservedRunningTime="2026-07-13 18:32:17.634896194 +0000 UTC m=+24.722001659"
Jul 13 18:32:17.650248 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.650190    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7nm2p" podStartSLOduration=2.730591284 podStartE2EDuration="23.650173315s" totalImagesPullingTime="20.919582031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:17.649409903 +0000 UTC m=+24.736515370" watchObservedRunningTime="2026-07-13 18:32:17.650173315 +0000 UTC m=+24.737278781"
Jul 13 18:32:17.669097 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.669052    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5qqkl" podStartSLOduration=2.723273194 podStartE2EDuration="23.669035149s" totalImagesPullingTime="20.945761955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:17.668164235 +0000 UTC m=+24.755269712" watchObservedRunningTime="2026-07-13 18:32:17.669035149 +0000 UTC m=+24.756140615"
Jul 13 18:32:17.701944 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.701907    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2hnml" podStartSLOduration=2.799163826 podStartE2EDuration="23.701894476s" totalImagesPullingTime="20.90273065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:17.701513681 +0000 UTC m=+24.788619166" watchObservedRunningTime="2026-07-13 18:32:17.701894476 +0000 UTC m=+24.788999941"
Jul 13 18:32:17.757652 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.757599    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4f2sg" podStartSLOduration=2.844298947 podStartE2EDuration="23.757581781s" totalImagesPullingTime="20.913282834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:17.757045667 +0000 UTC m=+24.844151153" watchObservedRunningTime="2026-07-13 18:32:17.757581781 +0000 UTC m=+24.844687247"
Jul 13 18:32:17.815043 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.814976    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:32:17.815447 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:17.815432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:32:18.459563 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:18.459530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:18.459563 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:18.459570    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:18.459829 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:18.459649    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:18.459829 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:18.459755    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:18.629279 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:18.629247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal" event={"ID":"a337b04f9774a1e52f1fa9a00cc413f8","Type":"ContainerStarted","Data":"df2af3e6de84833f423e8aebd6809701b52b97d1e85caf86947930c0a7364f43"}
Jul 13 18:32:18.631110 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:18.631013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2plhb" event={"ID":"d9017d37-5039-4eb0-bcb5-92bdbd792deb","Type":"ContainerStarted","Data":"2db70822b5ba83beb7c584ae220f688696ae3e45ff4aa1f7b5da451668da6c90"}
Jul 13 18:32:18.645169 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:18.645128    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal" podStartSLOduration=23.645110591 podStartE2EDuration="23.645110591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:18.64419934 +0000 UTC m=+25.731304833" watchObservedRunningTime="2026-07-13 18:32:18.645110591 +0000 UTC m=+25.732216056"
Jul 13 18:32:18.657562 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:18.657521    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2plhb" podStartSLOduration=3.740544193 podStartE2EDuration="24.657505662s" totalImagesPullingTime="20.916961469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:18.657001191 +0000 UTC m=+25.744106657" watchObservedRunningTime="2026-07-13 18:32:18.657505662 +0000 UTC m=+25.744611128"
Jul 13 18:32:18.682155 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:18.682135    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 18:32:19.349232 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:19.349148    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T18:32:18.682151702Z","UUID":"665fa16f-400f-4854-8086-b2e6f0bde354","Handler":null,"Name":"","Endpoint":""}
Jul 13 18:32:19.351170 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:19.350981    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 18:32:19.351279 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:19.351198    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 18:32:19.459529 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:19.459502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:19.459691 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:19.459637    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:19.636669 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:19.636600    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:32:19.637108 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:19.636946    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" event={"ID":"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f","Type":"ContainerStarted","Data":"842e5dcc21c968d27f767ccb09ee7cb19e240041e2c5c62342f6bd86f5177036"}
Jul 13 18:32:19.638534 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:19.638509    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 18:32:19.638643 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:19.638507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l" event={"ID":"f06e2641-6546-430d-a73d-80c68b760a45","Type":"ContainerStarted","Data":"e7a5b71398715eaea7fd73c200302a28ff40c8dfd901ed4d701c8fd997cc88e4"}
Jul 13 18:32:20.460044 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:20.460014    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:20.460334 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:20.460014    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:20.460334 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:20.460158    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:20.460334 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:20.460214    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:21.460018 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:21.459988    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:21.460712 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:21.460125    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:21.484680 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:21.484641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:32:21.484851 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:21.484783    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 18:32:21.485250 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:21.485220    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n4lzg"
Jul 13 18:32:22.459605 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:22.459573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:22.459803 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:22.459573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:22.459803 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:22.459715    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:22.459803 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:22.459757    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:23.460374 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.460196    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:23.460901 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:23.460440    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:23.648798 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.648764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l" event={"ID":"f06e2641-6546-430d-a73d-80c68b760a45","Type":"ContainerStarted","Data":"d2d01ec1784fe3e13f1ff029106b0154a39ddcbe12386b7257b1fdc35e3ca752"}
Jul 13 18:32:23.650516 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.650493    2565 generic.go:356] "Generic (PLEG): container finished" podID="be6726ef-f078-4798-9638-6d710a53c037" containerID="74acada129436d1c76b9ec3b064b0307361c6ab5862ad387af15e4f8d3f55409" exitCode=0
Jul 13 18:32:23.650642 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.650573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bk9s" event={"ID":"be6726ef-f078-4798-9638-6d710a53c037","Type":"ContainerDied","Data":"74acada129436d1c76b9ec3b064b0307361c6ab5862ad387af15e4f8d3f55409"}
Jul 13 18:32:23.654133 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.654113    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:32:23.654514 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.654496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" event={"ID":"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f","Type":"ContainerStarted","Data":"2535d99569576baedaa62e5a8bf38dd8f93ad7c586329be228f35afaf1ec30e0"}
Jul 13 18:32:23.654712 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.654701    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:32:23.654778 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.654751    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:32:23.654878 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.654862    2565 scope.go:117] "RemoveContainer" containerID="5fe673251bdbe33d1538b78494722bdd92381b7e054433a154aa9bc2d2b1a710"
Jul 13 18:32:23.671654 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.671631    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:32:23.674117 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:23.674066    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jm9l" podStartSLOduration=3.214608064 podStartE2EDuration="29.674048697s" totalImagesPullingTime="26.459440633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:23.672530083 +0000 UTC m=+30.759635565" watchObservedRunningTime="2026-07-13 18:32:23.674048697 +0000 UTC m=+30.761154163"
Jul 13 18:32:24.459608 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:24.459569    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:24.459789 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:24.459704    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:24.459879 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:24.459817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:24.459966 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:24.459939    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:24.661217 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:24.661181    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:32:24.661736 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:24.661615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" event={"ID":"8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f","Type":"ContainerStarted","Data":"ea82809f792843c5556891d1c61a4ba96ac3330fd333b090db705790a8010364"}
Jul 13 18:32:24.662038 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:24.662012    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:32:24.679701 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:24.679675    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:32:24.701902 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:24.701856    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g" podStartSLOduration=9.75491922 podStartE2EDuration="30.701835862s" totalImagesPullingTime="20.946916642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:24.701301534 +0000 UTC m=+31.788407022" watchObservedRunningTime="2026-07-13 18:32:24.701835862 +0000 UTC m=+31.788941327"
Jul 13 18:32:25.388538 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:25.388442    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8gf7z"]
Jul 13 18:32:25.388703 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:25.388601    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:25.388779 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:25.388696    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:25.394266 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:25.394228    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jmmm5"]
Jul 13 18:32:25.394391 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:25.394363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:25.394506 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:25.394453    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:25.394763 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:25.394744    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b5qm6"]
Jul 13 18:32:25.394835 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:25.394825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:25.394918 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:25.394901    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:25.666351 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:25.666320    2565 generic.go:356] "Generic (PLEG): container finished" podID="be6726ef-f078-4798-9638-6d710a53c037" containerID="bd771b8bc809b869341f1f893027fd4f36c74afb6631aa8ff79d3392c811b0f6" exitCode=0
Jul 13 18:32:25.666713 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:25.666364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bk9s" event={"ID":"be6726ef-f078-4798-9638-6d710a53c037","Type":"ContainerDied","Data":"bd771b8bc809b869341f1f893027fd4f36c74afb6631aa8ff79d3392c811b0f6"}
Jul 13 18:32:27.059573 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:27.059492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:27.059573 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:27.059547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:27.060224 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.059641    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:32:27.060224 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.059646    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:32:27.060224 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.059687    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs podName:b3e8e599-4106-42f0-97f1-a35fdf7afc9c nodeName:}" failed. No retries permitted until 2026-07-13 18:32:59.059674316 +0000 UTC m=+66.146779758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs") pod "network-metrics-daemon-jmmm5" (UID: "b3e8e599-4106-42f0-97f1-a35fdf7afc9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:32:27.060224 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.059700    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret podName:c58fee49-7c00-4083-ab69-fe0b779a3e5f nodeName:}" failed. No retries permitted until 2026-07-13 18:32:59.059693606 +0000 UTC m=+66.146799048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret") pod "global-pull-secret-syncer-8gf7z" (UID: "c58fee49-7c00-4083-ab69-fe0b779a3e5f") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:32:27.160213 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:27.160180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvz4\" (UniqueName: \"kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4\") pod \"network-check-target-b5qm6\" (UID: \"419152ca-c25c-48c9-9326-7f2e04e4e8aa\") " pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:27.160364 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.160321    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:32:27.160364 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.160341    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:32:27.160364 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.160354    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vzvz4 for pod openshift-network-diagnostics/network-check-target-b5qm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:32:27.160535 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.160414    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4 podName:419152ca-c25c-48c9-9326-7f2e04e4e8aa nodeName:}" failed. No retries permitted until 2026-07-13 18:32:59.160396093 +0000 UTC m=+66.247501553 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzvz4" (UniqueName: "kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4") pod "network-check-target-b5qm6" (UID: "419152ca-c25c-48c9-9326-7f2e04e4e8aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:32:27.459193 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:27.459165    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:27.459449 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:27.459199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:27.459449 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:27.459173    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:27.459449 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.459278    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:27.459449 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.459343    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:27.459643 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:27.459444    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:27.674144 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:27.674102    2565 generic.go:356] "Generic (PLEG): container finished" podID="be6726ef-f078-4798-9638-6d710a53c037" containerID="cfc3800fd5e6544c12399eb2c60ab79e902eee60187c452482115e30e931891a" exitCode=0
Jul 13 18:32:27.674144 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:27.674143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bk9s" event={"ID":"be6726ef-f078-4798-9638-6d710a53c037","Type":"ContainerDied","Data":"cfc3800fd5e6544c12399eb2c60ab79e902eee60187c452482115e30e931891a"}
Jul 13 18:32:29.459682 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.459588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:29.460172 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:29.459710    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gf7z" podUID="c58fee49-7c00-4083-ab69-fe0b779a3e5f"
Jul 13 18:32:29.460172 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.459588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:29.460172 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.459746    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:29.460172 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:29.459837    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmmm5" podUID="b3e8e599-4106-42f0-97f1-a35fdf7afc9c"
Jul 13 18:32:29.460172 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:29.459912    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5qm6" podUID="419152ca-c25c-48c9-9326-7f2e04e4e8aa"
Jul 13 18:32:29.690038 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.690004    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeReady"
Jul 13 18:32:29.690195 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.690163    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 18:32:29.727584 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.727451    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57f98f988d-j6m6r"]
Jul 13 18:32:29.729583 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.729560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.732162 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.732142    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 18:32:29.732487 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.732449    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 18:32:29.732578 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.732452    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 18:32:29.732653 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.732504    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gx49k\""
Jul 13 18:32:29.738075 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.738046    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 18:32:29.745028 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.745007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f98f988d-j6m6r"]
Jul 13 18:32:29.748930 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.748900    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vnb7d"]
Jul 13 18:32:29.751198 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.751180    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qfw8h"]
Jul 13 18:32:29.751310 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.751291    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.752898 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.752882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qfw8h"
Jul 13 18:32:29.754458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.754325    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tnbnw\""
Jul 13 18:32:29.754458 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.754350    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 18:32:29.755066 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.754989    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 18:32:29.755292 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.755278    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 18:32:29.756167 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.755648    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 18:32:29.756167 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.755668    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 18:32:29.756167 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.755727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-phpw8\""
Jul 13 18:32:29.766946 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.766432    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vnb7d"]
Jul 13 18:32:29.767026 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.767004    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qfw8h"]
Jul 13 18:32:29.880069 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/478dd6b1-dc33-48b8-a5e7-a34a2039914b-config-volume\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.880254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjndn\" (UniqueName: \"kubernetes.io/projected/06562cd2-d027-4c32-8e76-8f7c5979a38f-kube-api-access-fjndn\") pod \"ingress-canary-qfw8h\" (UID: \"06562cd2-d027-4c32-8e76-8f7c5979a38f\") " pod="openshift-ingress-canary/ingress-canary-qfw8h"
Jul 13 18:32:29.880254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.880254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-bound-sa-token\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.880254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478dd6b1-dc33-48b8-a5e7-a34a2039914b-tmp-dir\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.880254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-trusted-ca\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.880254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.880504 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtpmq\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-kube-api-access-wtpmq\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.880504 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-certificates\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.880504 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-image-registry-private-configuration\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.880504 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ff079e0-04ae-462d-9820-c501e3fcd0e8-ca-trust-extracted\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.880504 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06562cd2-d027-4c32-8e76-8f7c5979a38f-cert\") pod \"ingress-canary-qfw8h\" (UID: \"06562cd2-d027-4c32-8e76-8f7c5979a38f\") " pod="openshift-ingress-canary/ingress-canary-qfw8h"
Jul 13 18:32:29.880739 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-installation-pull-secrets\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.880739 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.880609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mdvq\" (UniqueName: \"kubernetes.io/projected/478dd6b1-dc33-48b8-a5e7-a34a2039914b-kube-api-access-5mdvq\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.981186 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-certificates\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.981186 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-image-registry-private-configuration\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.981186 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ff079e0-04ae-462d-9820-c501e3fcd0e8-ca-trust-extracted\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.981409 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06562cd2-d027-4c32-8e76-8f7c5979a38f-cert\") pod \"ingress-canary-qfw8h\" (UID: \"06562cd2-d027-4c32-8e76-8f7c5979a38f\") " pod="openshift-ingress-canary/ingress-canary-qfw8h"
Jul 13 18:32:29.981409 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-installation-pull-secrets\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.981409 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mdvq\" (UniqueName: \"kubernetes.io/projected/478dd6b1-dc33-48b8-a5e7-a34a2039914b-kube-api-access-5mdvq\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.981409 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/478dd6b1-dc33-48b8-a5e7-a34a2039914b-config-volume\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.981409 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjndn\" (UniqueName: \"kubernetes.io/projected/06562cd2-d027-4c32-8e76-8f7c5979a38f-kube-api-access-fjndn\") pod \"ingress-canary-qfw8h\" (UID: \"06562cd2-d027-4c32-8e76-8f7c5979a38f\") " pod="openshift-ingress-canary/ingress-canary-qfw8h"
Jul 13 18:32:29.981409 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.981696 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-bound-sa-token\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.981696 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478dd6b1-dc33-48b8-a5e7-a34a2039914b-tmp-dir\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.981696 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-trusted-ca\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.981696 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.981696 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtpmq\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-kube-api-access-wtpmq\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.981696 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ff079e0-04ae-462d-9820-c501e3fcd0e8-ca-trust-extracted\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.981968 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:29.981734    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:32:29.981968 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:29.981748    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f98f988d-j6m6r: secret "image-registry-tls" not found
Jul 13 18:32:29.981968 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:29.981809    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls podName:9ff079e0-04ae-462d-9820-c501e3fcd0e8 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:30.48179082 +0000 UTC m=+37.568896263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls") pod "image-registry-57f98f988d-j6m6r" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8") : secret "image-registry-tls" not found
Jul 13 18:32:29.981968 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-certificates\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.981968 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.981867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478dd6b1-dc33-48b8-a5e7-a34a2039914b-tmp-dir\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.982167 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:29.982147    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:32:29.982229 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:29.982197    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls podName:478dd6b1-dc33-48b8-a5e7-a34a2039914b nodeName:}" failed. No retries permitted until 2026-07-13 18:32:30.482183894 +0000 UTC m=+37.569289336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls") pod "dns-default-vnb7d" (UID: "478dd6b1-dc33-48b8-a5e7-a34a2039914b") : secret "dns-default-metrics-tls" not found
Jul 13 18:32:29.982431 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.982407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-trusted-ca\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.982570 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.982535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/478dd6b1-dc33-48b8-a5e7-a34a2039914b-config-volume\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.986621 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.986561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-image-registry-private-configuration\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.986621 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.986570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06562cd2-d027-4c32-8e76-8f7c5979a38f-cert\") pod \"ingress-canary-qfw8h\" (UID: \"06562cd2-d027-4c32-8e76-8f7c5979a38f\") " pod="openshift-ingress-canary/ingress-canary-qfw8h"
Jul 13 18:32:29.987185 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.987164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-installation-pull-secrets\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.992670 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.992643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-bound-sa-token\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:29.992940 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.992899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjndn\" (UniqueName: \"kubernetes.io/projected/06562cd2-d027-4c32-8e76-8f7c5979a38f-kube-api-access-fjndn\") pod \"ingress-canary-qfw8h\" (UID: \"06562cd2-d027-4c32-8e76-8f7c5979a38f\") " pod="openshift-ingress-canary/ingress-canary-qfw8h"
Jul 13 18:32:29.993160 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.993086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mdvq\" (UniqueName: \"kubernetes.io/projected/478dd6b1-dc33-48b8-a5e7-a34a2039914b-kube-api-access-5mdvq\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:29.993811 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:29.993790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtpmq\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-kube-api-access-wtpmq\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:30.067826 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:30.067794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qfw8h"
Jul 13 18:32:30.224421 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:30.224244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qfw8h"]
Jul 13 18:32:30.228799 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:32:30.228770    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06562cd2_d027_4c32_8e76_8f7c5979a38f.slice/crio-9c83d2bc22c0f5fb5527613a8bf293a3330a0542c070e4da26d5314bfd89d500 WatchSource:0}: Error finding container 9c83d2bc22c0f5fb5527613a8bf293a3330a0542c070e4da26d5314bfd89d500: Status 404 returned error can't find the container with id 9c83d2bc22c0f5fb5527613a8bf293a3330a0542c070e4da26d5314bfd89d500
Jul 13 18:32:30.485837 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:30.485754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:30.485837 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:30.485795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:30.486420 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:30.485924    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:32:30.486420 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:30.485934    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:32:30.486420 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:30.485958    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f98f988d-j6m6r: secret "image-registry-tls" not found
Jul 13 18:32:30.486420 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:30.486001    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls podName:478dd6b1-dc33-48b8-a5e7-a34a2039914b nodeName:}" failed. No retries permitted until 2026-07-13 18:32:31.485982214 +0000 UTC m=+38.573087672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls") pod "dns-default-vnb7d" (UID: "478dd6b1-dc33-48b8-a5e7-a34a2039914b") : secret "dns-default-metrics-tls" not found
Jul 13 18:32:30.486420 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:30.486020    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls podName:9ff079e0-04ae-462d-9820-c501e3fcd0e8 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:31.48601058 +0000 UTC m=+38.573116024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls") pod "image-registry-57f98f988d-j6m6r" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8") : secret "image-registry-tls" not found
Jul 13 18:32:30.682676 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:30.682575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qfw8h" event={"ID":"06562cd2-d027-4c32-8e76-8f7c5979a38f","Type":"ContainerStarted","Data":"9c83d2bc22c0f5fb5527613a8bf293a3330a0542c070e4da26d5314bfd89d500"}
Jul 13 18:32:31.459676 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.459646    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:31.459929 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.459646    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:31.459929 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.459651    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:31.462711 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.462688    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 18:32:31.462870 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.462699    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 18:32:31.463759 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.463736    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ql2kw\""
Jul 13 18:32:31.463759 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.463750    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 18:32:31.463934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.463742    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 18:32:31.463934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.463860    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwd4z\""
Jul 13 18:32:31.493745 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.493720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:31.494108 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:31.493753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:31.494108 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:31.493873    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:32:31.494108 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:31.493888    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:32:31.494108 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:31.493907    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f98f988d-j6m6r: secret "image-registry-tls" not found
Jul 13 18:32:31.494108 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:31.493928    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls podName:478dd6b1-dc33-48b8-a5e7-a34a2039914b nodeName:}" failed. No retries permitted until 2026-07-13 18:32:33.493912405 +0000 UTC m=+40.581017851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls") pod "dns-default-vnb7d" (UID: "478dd6b1-dc33-48b8-a5e7-a34a2039914b") : secret "dns-default-metrics-tls" not found
Jul 13 18:32:31.494108 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:31.493949    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls podName:9ff079e0-04ae-462d-9820-c501e3fcd0e8 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:33.493937518 +0000 UTC m=+40.581042961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls") pod "image-registry-57f98f988d-j6m6r" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8") : secret "image-registry-tls" not found
Jul 13 18:32:32.690684 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:32.690645    2565 generic.go:356] "Generic (PLEG): container finished" podID="be6726ef-f078-4798-9638-6d710a53c037" containerID="b9e3defbb6c01ed69e5dda59cac022019207cc75c2fa946cdc312d7597e7d5d8" exitCode=0
Jul 13 18:32:32.691217 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:32.690697    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bk9s" event={"ID":"be6726ef-f078-4798-9638-6d710a53c037","Type":"ContainerDied","Data":"b9e3defbb6c01ed69e5dda59cac022019207cc75c2fa946cdc312d7597e7d5d8"}
Jul 13 18:32:33.510908 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:33.510650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:33.511084 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:33.510927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:33.511084 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:33.510762    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:32:33.511084 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:33.510999    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f98f988d-j6m6r: secret "image-registry-tls" not found
Jul 13 18:32:33.511084 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:33.511066    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls podName:9ff079e0-04ae-462d-9820-c501e3fcd0e8 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:37.511047345 +0000 UTC m=+44.598152792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls") pod "image-registry-57f98f988d-j6m6r" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8") : secret "image-registry-tls" not found
Jul 13 18:32:33.511298 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:33.511098    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:32:33.511298 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:33.511148    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls podName:478dd6b1-dc33-48b8-a5e7-a34a2039914b nodeName:}" failed. No retries permitted until 2026-07-13 18:32:37.511132596 +0000 UTC m=+44.598238041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls") pod "dns-default-vnb7d" (UID: "478dd6b1-dc33-48b8-a5e7-a34a2039914b") : secret "dns-default-metrics-tls" not found
Jul 13 18:32:33.696995 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:33.696961    2565 generic.go:356] "Generic (PLEG): container finished" podID="be6726ef-f078-4798-9638-6d710a53c037" containerID="b2cc86d801f90251b0f28769738134b68ff803492d64da405410f9c118dcae0b" exitCode=0
Jul 13 18:32:33.697395 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:33.697025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bk9s" event={"ID":"be6726ef-f078-4798-9638-6d710a53c037","Type":"ContainerDied","Data":"b2cc86d801f90251b0f28769738134b68ff803492d64da405410f9c118dcae0b"}
Jul 13 18:32:34.703070 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:34.703027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bk9s" event={"ID":"be6726ef-f078-4798-9638-6d710a53c037","Type":"ContainerStarted","Data":"2d74e66ef4c6c94a02f555fa0d3f3bb93c61c7c997d140888e1b273c30feed63"}
Jul 13 18:32:34.704533 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:34.704509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qfw8h" event={"ID":"06562cd2-d027-4c32-8e76-8f7c5979a38f","Type":"ContainerStarted","Data":"c7291a341f5846ef38f247b3f49a15f8cd70ab5a61ab7607b83037789b251b7e"}
Jul 13 18:32:34.729367 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:34.729308    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7bk9s" podStartSLOduration=7.88141927 podStartE2EDuration="40.729290881s" totalImagesPullingTime="32.847871611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:34.727661395 +0000 UTC m=+41.814766860" watchObservedRunningTime="2026-07-13 18:32:34.729290881 +0000 UTC m=+41.816396349"
Jul 13 18:32:34.747777 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:34.747718    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qfw8h" podStartSLOduration=1.7113864460000001 podStartE2EDuration="5.747702891s" totalImagesPullingTime="4.036316445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:34.746884944 +0000 UTC m=+41.833990424" watchObservedRunningTime="2026-07-13 18:32:34.747702891 +0000 UTC m=+41.834808357"
Jul 13 18:32:37.540644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:37.540605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:37.540644 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:37.540646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:37.541083 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:37.540750    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:32:37.541083 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:37.540766    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:32:37.541083 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:37.540770    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f98f988d-j6m6r: secret "image-registry-tls" not found
Jul 13 18:32:37.541083 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:37.540815    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls podName:478dd6b1-dc33-48b8-a5e7-a34a2039914b nodeName:}" failed. No retries permitted until 2026-07-13 18:32:45.540803255 +0000 UTC m=+52.627908698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls") pod "dns-default-vnb7d" (UID: "478dd6b1-dc33-48b8-a5e7-a34a2039914b") : secret "dns-default-metrics-tls" not found
Jul 13 18:32:37.541083 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:37.540830    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls podName:9ff079e0-04ae-462d-9820-c501e3fcd0e8 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:45.540822935 +0000 UTC m=+52.627928377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls") pod "image-registry-57f98f988d-j6m6r" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8") : secret "image-registry-tls" not found
Jul 13 18:32:45.601740 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:45.601704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:32:45.601740 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:45.601748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:32:45.602160 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:45.601865    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:32:45.602160 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:45.601884    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:32:45.602160 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:45.601884    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f98f988d-j6m6r: secret "image-registry-tls" not found
Jul 13 18:32:45.602160 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:45.601944    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls podName:478dd6b1-dc33-48b8-a5e7-a34a2039914b nodeName:}" failed. No retries permitted until 2026-07-13 18:33:01.601930706 +0000 UTC m=+68.689036150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls") pod "dns-default-vnb7d" (UID: "478dd6b1-dc33-48b8-a5e7-a34a2039914b") : secret "dns-default-metrics-tls" not found
Jul 13 18:32:45.602160 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:45.601958    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls podName:9ff079e0-04ae-462d-9820-c501e3fcd0e8 nodeName:}" failed. No retries permitted until 2026-07-13 18:33:01.60195187 +0000 UTC m=+68.689057313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls") pod "image-registry-57f98f988d-j6m6r" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8") : secret "image-registry-tls" not found
Jul 13 18:32:46.082148 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.082119    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-clkzx"]
Jul 13 18:32:46.097610 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.097579    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.098464 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.098438    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-clkzx"]
Jul 13 18:32:46.100829 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.100806    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 18:32:46.100946 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.100902    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 18:32:46.101989 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.101966    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 13 18:32:46.101989 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.101987    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mwmzm\""
Jul 13 18:32:46.102379 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.102355    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 13 18:32:46.107067 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.107051    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 13 18:32:46.205750 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.205679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db843a09-1042-4247-81c9-25bf59b3bb27-snapshots\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.205920 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.205765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db843a09-1042-4247-81c9-25bf59b3bb27-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.205920 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.205793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db843a09-1042-4247-81c9-25bf59b3bb27-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.205920 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.205874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpd64\" (UniqueName: \"kubernetes.io/projected/db843a09-1042-4247-81c9-25bf59b3bb27-kube-api-access-wpd64\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.205920 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.205913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db843a09-1042-4247-81c9-25bf59b3bb27-serving-cert\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.206046 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.205974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db843a09-1042-4247-81c9-25bf59b3bb27-tmp\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.241938 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.241911    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-2vnvh"]
Jul 13 18:32:46.263538 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.263510    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.268364 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.268339    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 13 18:32:46.268364 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.268360    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 13 18:32:46.268576 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.268380    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-p575r\""
Jul 13 18:32:46.268576 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.268449    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:32:46.269785 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.269691    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 13 18:32:46.281497 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.281460    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 13 18:32:46.281718 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.281701    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-2vnvh"]
Jul 13 18:32:46.306710 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.306674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db843a09-1042-4247-81c9-25bf59b3bb27-tmp\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.306867 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.306726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-serving-cert\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.306867 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.306744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-trusted-ca\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.306867 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.306776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db843a09-1042-4247-81c9-25bf59b3bb27-snapshots\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.306867 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.306833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db843a09-1042-4247-81c9-25bf59b3bb27-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.307011 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.306875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db843a09-1042-4247-81c9-25bf59b3bb27-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.307011 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.306894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-config\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.307011 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.306913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4758f\" (UniqueName: \"kubernetes.io/projected/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-kube-api-access-4758f\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.307011 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.306956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpd64\" (UniqueName: \"kubernetes.io/projected/db843a09-1042-4247-81c9-25bf59b3bb27-kube-api-access-wpd64\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.307011 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.306997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db843a09-1042-4247-81c9-25bf59b3bb27-serving-cert\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.307237 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.307092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db843a09-1042-4247-81c9-25bf59b3bb27-tmp\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.307376 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.307357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db843a09-1042-4247-81c9-25bf59b3bb27-snapshots\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.307439 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.307376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db843a09-1042-4247-81c9-25bf59b3bb27-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.307836 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.307814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db843a09-1042-4247-81c9-25bf59b3bb27-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.310960 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.310935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db843a09-1042-4247-81c9-25bf59b3bb27-serving-cert\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.327463 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.327444    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr"]
Jul 13 18:32:46.336941 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.336889    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpd64\" (UniqueName: \"kubernetes.io/projected/db843a09-1042-4247-81c9-25bf59b3bb27-kube-api-access-wpd64\") pod \"insights-operator-68d9dd94cf-clkzx\" (UID: \"db843a09-1042-4247-81c9-25bf59b3bb27\") " pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.344452 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.344432    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc"]
Jul 13 18:32:46.344578 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.344554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr"
Jul 13 18:32:46.350160 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.350135    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-k896b\""
Jul 13 18:32:46.386578 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.386546    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc"]
Jul 13 18:32:46.386578 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.386577    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr"]
Jul 13 18:32:46.386797 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.386676    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc"
Jul 13 18:32:46.396654 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.396627    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-f6rfw\""
Jul 13 18:32:46.396799 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.396773    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:32:46.396907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.396893    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 13 18:32:46.407626 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.407606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-serving-cert\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.407716 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.407628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-trusted-ca\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.407716 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.407648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t6dl\" (UniqueName: \"kubernetes.io/projected/6288b7f2-072a-4ab1-a020-3ee8689ac961-kube-api-access-5t6dl\") pod \"network-check-source-869dcfcdcd-h5lnr\" (UID: \"6288b7f2-072a-4ab1-a020-3ee8689ac961\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr"
Jul 13 18:32:46.407716 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.407676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25dgk\" (UniqueName: \"kubernetes.io/projected/965ee80a-32e5-4786-9089-514f8d443857-kube-api-access-25dgk\") pod \"volume-data-source-validator-78495597f6-h2flc\" (UID: \"965ee80a-32e5-4786-9089-514f8d443857\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc"
Jul 13 18:32:46.407902 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.407801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-config\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.407902 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.407814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-clkzx"
Jul 13 18:32:46.407902 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.407832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4758f\" (UniqueName: \"kubernetes.io/projected/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-kube-api-access-4758f\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.408385 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.408360    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-config\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.408454 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.408422    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-trusted-ca\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.410078 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.410061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-serving-cert\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.434859 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.434834    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-g65jc"]
Jul 13 18:32:46.434945 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.434892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4758f\" (UniqueName: \"kubernetes.io/projected/904aa018-ac3c-4bff-bc2f-e8ec38db5ef1-kube-api-access-4758f\") pod \"console-operator-7866497494-2vnvh\" (UID: \"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1\") " pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.454008 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.453927    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"]
Jul 13 18:32:46.454008 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.454053    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:32:46.457168 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.457150    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 13 18:32:46.457310 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.457156    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 13 18:32:46.457310 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.457156    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kf2qh\""
Jul 13 18:32:46.474197 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.474142    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-g65jc"]
Jul 13 18:32:46.474197 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.474185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"]
Jul 13 18:32:46.474343 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.474246    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.477215 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.477175    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 13 18:32:46.477331 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.477219    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zjfdb\""
Jul 13 18:32:46.477331 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.477250    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:32:46.477331 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.477181    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 13 18:32:46.477509 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.477488    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 13 18:32:46.508810 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.508776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8bb9ff9-4849-4cc2-a2a5-b3436ee78780-config\") pod \"service-ca-operator-7695fc6c8c-xbrgg\" (UID: \"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.508970 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.508921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/452e820d-e6a0-4182-acaf-26ac432d9bc9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:32:46.509034 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.508961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t6dl\" (UniqueName: \"kubernetes.io/projected/6288b7f2-072a-4ab1-a020-3ee8689ac961-kube-api-access-5t6dl\") pod \"network-check-source-869dcfcdcd-h5lnr\" (UID: \"6288b7f2-072a-4ab1-a020-3ee8689ac961\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr"
Jul 13 18:32:46.509085 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.509040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25dgk\" (UniqueName: \"kubernetes.io/projected/965ee80a-32e5-4786-9089-514f8d443857-kube-api-access-25dgk\") pod \"volume-data-source-validator-78495597f6-h2flc\" (UID: \"965ee80a-32e5-4786-9089-514f8d443857\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc"
Jul 13 18:32:46.509085 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.509075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8bb9ff9-4849-4cc2-a2a5-b3436ee78780-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xbrgg\" (UID: \"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.509176 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.509102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cfcd\" (UniqueName: \"kubernetes.io/projected/d8bb9ff9-4849-4cc2-a2a5-b3436ee78780-kube-api-access-4cfcd\") pod \"service-ca-operator-7695fc6c8c-xbrgg\" (UID: \"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.509176 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.509133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:32:46.531681 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.531658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25dgk\" (UniqueName: \"kubernetes.io/projected/965ee80a-32e5-4786-9089-514f8d443857-kube-api-access-25dgk\") pod \"volume-data-source-validator-78495597f6-h2flc\" (UID: \"965ee80a-32e5-4786-9089-514f8d443857\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc"
Jul 13 18:32:46.534297 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.534275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t6dl\" (UniqueName: \"kubernetes.io/projected/6288b7f2-072a-4ab1-a020-3ee8689ac961-kube-api-access-5t6dl\") pod \"network-check-source-869dcfcdcd-h5lnr\" (UID: \"6288b7f2-072a-4ab1-a020-3ee8689ac961\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr"
Jul 13 18:32:46.574019 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.573991    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:46.575464 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.575442    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-clkzx"]
Jul 13 18:32:46.578250 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:32:46.578227    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb843a09_1042_4247_81c9_25bf59b3bb27.slice/crio-8649d90c6be8cc87a21c73f1d813f1ce44109ca1f277b55bc6a75d5965e873ef WatchSource:0}: Error finding container 8649d90c6be8cc87a21c73f1d813f1ce44109ca1f277b55bc6a75d5965e873ef: Status 404 returned error can't find the container with id 8649d90c6be8cc87a21c73f1d813f1ce44109ca1f277b55bc6a75d5965e873ef
Jul 13 18:32:46.609724 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.609698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:32:46.610067 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.609763    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8bb9ff9-4849-4cc2-a2a5-b3436ee78780-config\") pod \"service-ca-operator-7695fc6c8c-xbrgg\" (UID: \"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.610067 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.609806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/452e820d-e6a0-4182-acaf-26ac432d9bc9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:32:46.610067 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.609842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8bb9ff9-4849-4cc2-a2a5-b3436ee78780-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xbrgg\" (UID: \"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.610067 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.609858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cfcd\" (UniqueName: \"kubernetes.io/projected/d8bb9ff9-4849-4cc2-a2a5-b3436ee78780-kube-api-access-4cfcd\") pod \"service-ca-operator-7695fc6c8c-xbrgg\" (UID: \"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.610067 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:46.609880    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 18:32:46.610067 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:46.609951    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert podName:452e820d-e6a0-4182-acaf-26ac432d9bc9 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:47.109930502 +0000 UTC m=+54.197035963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-g65jc" (UID: "452e820d-e6a0-4182-acaf-26ac432d9bc9") : secret "networking-console-plugin-cert" not found
Jul 13 18:32:46.610301 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.610286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8bb9ff9-4849-4cc2-a2a5-b3436ee78780-config\") pod \"service-ca-operator-7695fc6c8c-xbrgg\" (UID: \"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.610633 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.610612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/452e820d-e6a0-4182-acaf-26ac432d9bc9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:32:46.612091 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.612074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8bb9ff9-4849-4cc2-a2a5-b3436ee78780-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xbrgg\" (UID: \"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.629229 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.629204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cfcd\" (UniqueName: \"kubernetes.io/projected/d8bb9ff9-4849-4cc2-a2a5-b3436ee78780-kube-api-access-4cfcd\") pod \"service-ca-operator-7695fc6c8c-xbrgg\" (UID: \"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.665171 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.665143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr"
Jul 13 18:32:46.694865 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.694838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc"
Jul 13 18:32:46.732115 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.732079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-clkzx" event={"ID":"db843a09-1042-4247-81c9-25bf59b3bb27","Type":"ContainerStarted","Data":"8649d90c6be8cc87a21c73f1d813f1ce44109ca1f277b55bc6a75d5965e873ef"}
Jul 13 18:32:46.736000 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.735976    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-2vnvh"]
Jul 13 18:32:46.737082 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:32:46.737062    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904aa018_ac3c_4bff_bc2f_e8ec38db5ef1.slice/crio-726ba9f7f5e2b2687dacd4863abc32b312f3ec9328ea77c31a22f8899d4c81e3 WatchSource:0}: Error finding container 726ba9f7f5e2b2687dacd4863abc32b312f3ec9328ea77c31a22f8899d4c81e3: Status 404 returned error can't find the container with id 726ba9f7f5e2b2687dacd4863abc32b312f3ec9328ea77c31a22f8899d4c81e3
Jul 13 18:32:46.783861 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.783832    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"
Jul 13 18:32:46.838012 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.837983    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr"]
Jul 13 18:32:46.841126 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:32:46.841095    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6288b7f2_072a_4ab1_a020_3ee8689ac961.slice/crio-ab29d9f146e2f5efe344e93a969ed3043eb1486a8ba31c68f59927a517545fb8 WatchSource:0}: Error finding container ab29d9f146e2f5efe344e93a969ed3043eb1486a8ba31c68f59927a517545fb8: Status 404 returned error can't find the container with id ab29d9f146e2f5efe344e93a969ed3043eb1486a8ba31c68f59927a517545fb8
Jul 13 18:32:46.861898 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.861268    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc"]
Jul 13 18:32:46.866933 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:32:46.866908    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965ee80a_32e5_4786_9089_514f8d443857.slice/crio-ccbb2b1657745af60e297f2fd48ebe1026e3c3fff1d7e4c40f4b79208ee65d73 WatchSource:0}: Error finding container ccbb2b1657745af60e297f2fd48ebe1026e3c3fff1d7e4c40f4b79208ee65d73: Status 404 returned error can't find the container with id ccbb2b1657745af60e297f2fd48ebe1026e3c3fff1d7e4c40f4b79208ee65d73
Jul 13 18:32:46.934797 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:46.934767    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg"]
Jul 13 18:32:46.937584 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:32:46.937562    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8bb9ff9_4849_4cc2_a2a5_b3436ee78780.slice/crio-6376f2768454259019e76ad1aa49e8794d3ac20515d96c587cdf87024f94127a WatchSource:0}: Error finding container 6376f2768454259019e76ad1aa49e8794d3ac20515d96c587cdf87024f94127a: Status 404 returned error can't find the container with id 6376f2768454259019e76ad1aa49e8794d3ac20515d96c587cdf87024f94127a
Jul 13 18:32:47.114345 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:47.114263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:32:47.114504 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:47.114413    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 18:32:47.114567 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:47.114504    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert podName:452e820d-e6a0-4182-acaf-26ac432d9bc9 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:48.114483255 +0000 UTC m=+55.201588712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-g65jc" (UID: "452e820d-e6a0-4182-acaf-26ac432d9bc9") : secret "networking-console-plugin-cert" not found
Jul 13 18:32:47.736700 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:47.736661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc" event={"ID":"965ee80a-32e5-4786-9089-514f8d443857","Type":"ContainerStarted","Data":"ccbb2b1657745af60e297f2fd48ebe1026e3c3fff1d7e4c40f4b79208ee65d73"}
Jul 13 18:32:47.738747 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:47.738675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr" event={"ID":"6288b7f2-072a-4ab1-a020-3ee8689ac961","Type":"ContainerStarted","Data":"ab29d9f146e2f5efe344e93a969ed3043eb1486a8ba31c68f59927a517545fb8"}
Jul 13 18:32:47.741019 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:47.740923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg" event={"ID":"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780","Type":"ContainerStarted","Data":"6376f2768454259019e76ad1aa49e8794d3ac20515d96c587cdf87024f94127a"}
Jul 13 18:32:47.742453 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:47.742403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-2vnvh" event={"ID":"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1","Type":"ContainerStarted","Data":"726ba9f7f5e2b2687dacd4863abc32b312f3ec9328ea77c31a22f8899d4c81e3"}
Jul 13 18:32:48.124993 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:48.124899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:32:48.125267 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:48.125154    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 18:32:48.125871 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:48.125851    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert podName:452e820d-e6a0-4182-acaf-26ac432d9bc9 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:50.125211741 +0000 UTC m=+57.212317188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-g65jc" (UID: "452e820d-e6a0-4182-acaf-26ac432d9bc9") : secret "networking-console-plugin-cert" not found
Jul 13 18:32:48.747399 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:48.746841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc" event={"ID":"965ee80a-32e5-4786-9089-514f8d443857","Type":"ContainerStarted","Data":"ee91181dd8324111098640e3b47a8176308909ce5eb820f00a49d1bd729723df"}
Jul 13 18:32:48.768829 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:48.768777    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h2flc" podStartSLOduration=1.075649136 podStartE2EDuration="2.768760458s" totalImagesPullingTime="1.693111322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:48.767400538 +0000 UTC m=+55.854506019" watchObservedRunningTime="2026-07-13 18:32:48.768760458 +0000 UTC m=+55.855865959"
Jul 13 18:32:50.143493 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:50.143437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:32:50.143951 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:50.143594    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 18:32:50.143951 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:50.143668    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert podName:452e820d-e6a0-4182-acaf-26ac432d9bc9 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:54.143652562 +0000 UTC m=+61.230758009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-g65jc" (UID: "452e820d-e6a0-4182-acaf-26ac432d9bc9") : secret "networking-console-plugin-cert" not found
Jul 13 18:32:51.142508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.142448    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd"]
Jul 13 18:32:51.146301 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.146276    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd"
Jul 13 18:32:51.151979 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.151951    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 13 18:32:51.152649 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.152625    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mcvq6\""
Jul 13 18:32:51.152760 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.152656    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 13 18:32:51.169559 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.169536    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd"]
Jul 13 18:32:51.254528 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.254494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rsvd\" (UniqueName: \"kubernetes.io/projected/52a903d7-0e86-4847-ae21-e255302e7dd7-kube-api-access-4rsvd\") pod \"migrator-7f59b54f6c-tbnnd\" (UID: \"52a903d7-0e86-4847-ae21-e255302e7dd7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd"
Jul 13 18:32:51.354959 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.354917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rsvd\" (UniqueName: \"kubernetes.io/projected/52a903d7-0e86-4847-ae21-e255302e7dd7-kube-api-access-4rsvd\") pod \"migrator-7f59b54f6c-tbnnd\" (UID: \"52a903d7-0e86-4847-ae21-e255302e7dd7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd"
Jul 13 18:32:51.378029 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.377995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rsvd\" (UniqueName: \"kubernetes.io/projected/52a903d7-0e86-4847-ae21-e255302e7dd7-kube-api-access-4rsvd\") pod \"migrator-7f59b54f6c-tbnnd\" (UID: \"52a903d7-0e86-4847-ae21-e255302e7dd7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd"
Jul 13 18:32:51.456746 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.456728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd"
Jul 13 18:32:51.614724 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.614686    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd"]
Jul 13 18:32:51.628432 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:32:51.628395    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a903d7_0e86_4847_ae21_e255302e7dd7.slice/crio-5d57dec8374aa52022ebc60e8fcdf12e9d9181aed11e8dc6df5827ed5e4cc360 WatchSource:0}: Error finding container 5d57dec8374aa52022ebc60e8fcdf12e9d9181aed11e8dc6df5827ed5e4cc360: Status 404 returned error can't find the container with id 5d57dec8374aa52022ebc60e8fcdf12e9d9181aed11e8dc6df5827ed5e4cc360
Jul 13 18:32:51.758044 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.757925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr" event={"ID":"6288b7f2-072a-4ab1-a020-3ee8689ac961","Type":"ContainerStarted","Data":"8a70ab087b054cf66b44ee8a7918547c34ac4c73710d3a5bef07b22dcce9ee4d"}
Jul 13 18:32:51.759586 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.759556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg" event={"ID":"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780","Type":"ContainerStarted","Data":"15eacc2d47def63ae74708e323415ce135c2a505d2afe65414a66280a1600f28"}
Jul 13 18:32:51.761215 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.761197    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/0.log"
Jul 13 18:32:51.761313 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.761235    2565 generic.go:356] "Generic (PLEG): container finished" podID="904aa018-ac3c-4bff-bc2f-e8ec38db5ef1" containerID="37e0d8d93c2434123fb79dc2c0a2970dfbf4d4197567f844a95b7d343fc27e7f" exitCode=255
Jul 13 18:32:51.761380 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.761310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-2vnvh" event={"ID":"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1","Type":"ContainerDied","Data":"37e0d8d93c2434123fb79dc2c0a2970dfbf4d4197567f844a95b7d343fc27e7f"}
Jul 13 18:32:51.761581 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.761531    2565 scope.go:117] "RemoveContainer" containerID="37e0d8d93c2434123fb79dc2c0a2970dfbf4d4197567f844a95b7d343fc27e7f"
Jul 13 18:32:51.762522 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.762498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd" event={"ID":"52a903d7-0e86-4847-ae21-e255302e7dd7","Type":"ContainerStarted","Data":"5d57dec8374aa52022ebc60e8fcdf12e9d9181aed11e8dc6df5827ed5e4cc360"}
Jul 13 18:32:51.764150 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.764124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-clkzx" event={"ID":"db843a09-1042-4247-81c9-25bf59b3bb27","Type":"ContainerStarted","Data":"44430eedc354aa41b90d1d1efba383786dcc456bf1a34548871acb425a707778"}
Jul 13 18:32:51.779133 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.779093    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5lnr" podStartSLOduration=1.209377603 podStartE2EDuration="5.779077998s" totalImagesPullingTime="4.569700395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:51.77810254 +0000 UTC m=+58.865208004" watchObservedRunningTime="2026-07-13 18:32:51.779077998 +0000 UTC m=+58.866183460"
Jul 13 18:32:51.818501 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.818052    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg" podStartSLOduration=1.352860145 podStartE2EDuration="5.818031963s" totalImagesPullingTime="4.465171818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:51.817404361 +0000 UTC m=+58.904509827" watchObservedRunningTime="2026-07-13 18:32:51.818031963 +0000 UTC m=+58.905137430"
Jul 13 18:32:51.843137 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:51.843072    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-clkzx" podStartSLOduration=1.024861076 podStartE2EDuration="5.843049921s" totalImagesPullingTime="4.818188845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:51.842504002 +0000 UTC m=+58.929609494" watchObservedRunningTime="2026-07-13 18:32:51.843049921 +0000 UTC m=+58.930155392"
Jul 13 18:32:52.768735 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:52.768715    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/1.log"
Jul 13 18:32:52.769220 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:52.769203    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/0.log"
Jul 13 18:32:52.769271 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:52.769246    2565 generic.go:356] "Generic (PLEG): container finished" podID="904aa018-ac3c-4bff-bc2f-e8ec38db5ef1" containerID="6c4844326174c848792018d95939f0ff23154b745d92605504966f5a53afde95" exitCode=255
Jul 13 18:32:52.769367 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:52.769345    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-2vnvh" event={"ID":"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1","Type":"ContainerDied","Data":"6c4844326174c848792018d95939f0ff23154b745d92605504966f5a53afde95"}
Jul 13 18:32:52.769430 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:52.769417    2565 scope.go:117] "RemoveContainer" containerID="37e0d8d93c2434123fb79dc2c0a2970dfbf4d4197567f844a95b7d343fc27e7f"
Jul 13 18:32:52.770054 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:52.769669    2565 scope.go:117] "RemoveContainer" containerID="6c4844326174c848792018d95939f0ff23154b745d92605504966f5a53afde95"
Jul 13 18:32:52.770054 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:52.769855    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-2vnvh_openshift-console-operator(904aa018-ac3c-4bff-bc2f-e8ec38db5ef1)\"" pod="openshift-console-operator/console-operator-7866497494-2vnvh" podUID="904aa018-ac3c-4bff-bc2f-e8ec38db5ef1"
Jul 13 18:32:53.520930 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.520893    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bqv54"]
Jul 13 18:32:53.524446 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.524418    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.527356 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.527331    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 18:32:53.527506 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.527355    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vfssh\""
Jul 13 18:32:53.528300 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.528279    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 18:32:53.538846 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.538820    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bqv54"]
Jul 13 18:32:53.586030 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.585994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.586213 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.586057    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq5jk\" (UniqueName: \"kubernetes.io/projected/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-api-access-rq5jk\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.586213 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.586111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.586213 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.586136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/642c3171-a34a-4331-b2fd-37e19ba3d385-crio-socket\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.586213 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.586187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/642c3171-a34a-4331-b2fd-37e19ba3d385-data-volume\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.687309 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.687280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.687521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.687332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq5jk\" (UniqueName: \"kubernetes.io/projected/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-api-access-rq5jk\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.687521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.687357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.687521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.687377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/642c3171-a34a-4331-b2fd-37e19ba3d385-crio-socket\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.687521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.687395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/642c3171-a34a-4331-b2fd-37e19ba3d385-data-volume\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.687521 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:53.687417    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:32:53.687521 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:53.687462    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 18:32:53.687521 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.687497    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/642c3171-a34a-4331-b2fd-37e19ba3d385-crio-socket\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.687521 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:53.687513    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls podName:642c3171-a34a-4331-b2fd-37e19ba3d385 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:54.187492286 +0000 UTC m=+61.274597743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqv54" (UID: "642c3171-a34a-4331-b2fd-37e19ba3d385") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:32:53.687850 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:53.687547    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm podName:642c3171-a34a-4331-b2fd-37e19ba3d385 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:54.187529309 +0000 UTC m=+61.274634757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqv54" (UID: "642c3171-a34a-4331-b2fd-37e19ba3d385") : configmap "kube-rbac-proxy" not found
Jul 13 18:32:53.687850 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.687799    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/642c3171-a34a-4331-b2fd-37e19ba3d385-data-volume\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.696317 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.696297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq5jk\" (UniqueName: \"kubernetes.io/projected/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-api-access-rq5jk\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:53.774284 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.774213    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/1.log"
Jul 13 18:32:53.774731 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.774671    2565 scope.go:117] "RemoveContainer" containerID="6c4844326174c848792018d95939f0ff23154b745d92605504966f5a53afde95"
Jul 13 18:32:53.774869 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:53.774845    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-2vnvh_openshift-console-operator(904aa018-ac3c-4bff-bc2f-e8ec38db5ef1)\"" pod="openshift-console-operator/console-operator-7866497494-2vnvh" podUID="904aa018-ac3c-4bff-bc2f-e8ec38db5ef1"
Jul 13 18:32:53.776262 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.776237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd" event={"ID":"52a903d7-0e86-4847-ae21-e255302e7dd7","Type":"ContainerStarted","Data":"1dbf22f6fc3cb53367b8b95a13091b33aad6139328512cce9cf4511f225af3f4"}
Jul 13 18:32:53.776369 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.776279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd" event={"ID":"52a903d7-0e86-4847-ae21-e255302e7dd7","Type":"ContainerStarted","Data":"5a19d6c720843b9f0a297fd6d2b5ee86734727bea7a0c8537ec8f838ecf49a69"}
Jul 13 18:32:53.844680 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:53.844628    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbnnd" podStartSLOduration=1.738696822 podStartE2EDuration="2.844611821s" totalImagesPullingTime="1.105914999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:53.842821959 +0000 UTC m=+60.929927424" watchObservedRunningTime="2026-07-13 18:32:53.844611821 +0000 UTC m=+60.931717286"
Jul 13 18:32:54.192589 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:54.192549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:54.192767 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:54.192611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:32:54.192767 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:54.192636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:54.192767 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:54.192712    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 18:32:54.192767 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:54.192712    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:32:54.192888 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:54.192782    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm podName:642c3171-a34a-4331-b2fd-37e19ba3d385 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:55.192764939 +0000 UTC m=+62.279870396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqv54" (UID: "642c3171-a34a-4331-b2fd-37e19ba3d385") : configmap "kube-rbac-proxy" not found
Jul 13 18:32:54.192888 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:54.192780    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 18:32:54.192888 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:54.192797    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls podName:642c3171-a34a-4331-b2fd-37e19ba3d385 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:55.192789578 +0000 UTC m=+62.279895028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqv54" (UID: "642c3171-a34a-4331-b2fd-37e19ba3d385") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:32:54.192888 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:54.192842    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert podName:452e820d-e6a0-4182-acaf-26ac432d9bc9 nodeName:}" failed. No retries permitted until 2026-07-13 18:33:02.192825915 +0000 UTC m=+69.279931373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-g65jc" (UID: "452e820d-e6a0-4182-acaf-26ac432d9bc9") : secret "networking-console-plugin-cert" not found
Jul 13 18:32:55.203096 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.203001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:55.203096 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.203064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:55.203515 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:55.203158    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:32:55.203515 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:55.203177    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 18:32:55.203515 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:55.203228    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm podName:642c3171-a34a-4331-b2fd-37e19ba3d385 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:57.20320969 +0000 UTC m=+64.290315156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqv54" (UID: "642c3171-a34a-4331-b2fd-37e19ba3d385") : configmap "kube-rbac-proxy" not found
Jul 13 18:32:55.203515 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:55.203245    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls podName:642c3171-a34a-4331-b2fd-37e19ba3d385 nodeName:}" failed. No retries permitted until 2026-07-13 18:32:57.203236176 +0000 UTC m=+64.290341620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqv54" (UID: "642c3171-a34a-4331-b2fd-37e19ba3d385") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:32:55.402958 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.402928    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-wd2kx"]
Jul 13 18:32:55.426388 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.426364    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-wd2kx"]
Jul 13 18:32:55.426543 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.426508    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.429402 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.429382    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 13 18:32:55.429553 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.429382    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 13 18:32:55.429553 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.429382    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8cmcw\""
Jul 13 18:32:55.429553 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.429427    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 13 18:32:55.430288 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.430271    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 13 18:32:55.505983 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.505897    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/71f42a6b-f45e-4981-b9fe-902c67fc4308-signing-key\") pod \"service-ca-79f68b9f4f-wd2kx\" (UID: \"71f42a6b-f45e-4981-b9fe-902c67fc4308\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.505983 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.505937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/71f42a6b-f45e-4981-b9fe-902c67fc4308-signing-cabundle\") pod \"service-ca-79f68b9f4f-wd2kx\" (UID: \"71f42a6b-f45e-4981-b9fe-902c67fc4308\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.506185 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.506029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6584\" (UniqueName: \"kubernetes.io/projected/71f42a6b-f45e-4981-b9fe-902c67fc4308-kube-api-access-n6584\") pod \"service-ca-79f68b9f4f-wd2kx\" (UID: \"71f42a6b-f45e-4981-b9fe-902c67fc4308\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.606631 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.606603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/71f42a6b-f45e-4981-b9fe-902c67fc4308-signing-key\") pod \"service-ca-79f68b9f4f-wd2kx\" (UID: \"71f42a6b-f45e-4981-b9fe-902c67fc4308\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.606631 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.606633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/71f42a6b-f45e-4981-b9fe-902c67fc4308-signing-cabundle\") pod \"service-ca-79f68b9f4f-wd2kx\" (UID: \"71f42a6b-f45e-4981-b9fe-902c67fc4308\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.606882 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.606675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6584\" (UniqueName: \"kubernetes.io/projected/71f42a6b-f45e-4981-b9fe-902c67fc4308-kube-api-access-n6584\") pod \"service-ca-79f68b9f4f-wd2kx\" (UID: \"71f42a6b-f45e-4981-b9fe-902c67fc4308\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.607275 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.607249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/71f42a6b-f45e-4981-b9fe-902c67fc4308-signing-cabundle\") pod \"service-ca-79f68b9f4f-wd2kx\" (UID: \"71f42a6b-f45e-4981-b9fe-902c67fc4308\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.609139 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.609122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/71f42a6b-f45e-4981-b9fe-902c67fc4308-signing-key\") pod \"service-ca-79f68b9f4f-wd2kx\" (UID: \"71f42a6b-f45e-4981-b9fe-902c67fc4308\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.616850 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.616830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6584\" (UniqueName: \"kubernetes.io/projected/71f42a6b-f45e-4981-b9fe-902c67fc4308-kube-api-access-n6584\") pod \"service-ca-79f68b9f4f-wd2kx\" (UID: \"71f42a6b-f45e-4981-b9fe-902c67fc4308\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.711241 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.711213    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7nm2p_a7d6e830-818a-4bd4-80d2-87ed399309df/dns-node-resolver/0.log"
Jul 13 18:32:55.735402 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.735367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx"
Jul 13 18:32:55.875402 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:55.875371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-wd2kx"]
Jul 13 18:32:55.878167 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:32:55.878143    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f42a6b_f45e_4981_b9fe_902c67fc4308.slice/crio-f9948da84a249ab3c13cf71dae92291a295faf3211bafad0a2b2b1547aacc460 WatchSource:0}: Error finding container f9948da84a249ab3c13cf71dae92291a295faf3211bafad0a2b2b1547aacc460: Status 404 returned error can't find the container with id f9948da84a249ab3c13cf71dae92291a295faf3211bafad0a2b2b1547aacc460
Jul 13 18:32:56.574903 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:56.574867    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:56.575282 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:56.574923    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:32:56.575282 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:56.575270    2565 scope.go:117] "RemoveContainer" containerID="6c4844326174c848792018d95939f0ff23154b745d92605504966f5a53afde95"
Jul 13 18:32:56.575427 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:56.575409    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-2vnvh_openshift-console-operator(904aa018-ac3c-4bff-bc2f-e8ec38db5ef1)\"" pod="openshift-console-operator/console-operator-7866497494-2vnvh" podUID="904aa018-ac3c-4bff-bc2f-e8ec38db5ef1"
Jul 13 18:32:56.680651 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:56.680624    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2g87g"
Jul 13 18:32:56.713397 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:56.713362    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4f2sg_e96eecf0-f3c5-433f-ad85-222da1b718c5/node-ca/0.log"
Jul 13 18:32:56.787222 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:56.787184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx" event={"ID":"71f42a6b-f45e-4981-b9fe-902c67fc4308","Type":"ContainerStarted","Data":"e856b880c69c626d5333338eeeb1be8831b11f051248d614741399ddfd1e62d6"}
Jul 13 18:32:56.787380 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:56.787265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx" event={"ID":"71f42a6b-f45e-4981-b9fe-902c67fc4308","Type":"ContainerStarted","Data":"f9948da84a249ab3c13cf71dae92291a295faf3211bafad0a2b2b1547aacc460"}
Jul 13 18:32:56.813167 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:56.813119    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-wd2kx" podStartSLOduration=1.813105234 podStartE2EDuration="1.813105234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:56.812270988 +0000 UTC m=+63.899376478" watchObservedRunningTime="2026-07-13 18:32:56.813105234 +0000 UTC m=+63.900210699"
Jul 13 18:32:57.222811 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:57.222777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:57.222987 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:57.222844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:32:57.222987 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:57.222941    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:32:57.223054 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:57.223006    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 18:32:57.223088 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:57.223021    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls podName:642c3171-a34a-4331-b2fd-37e19ba3d385 nodeName:}" failed. No retries permitted until 2026-07-13 18:33:01.223004445 +0000 UTC m=+68.310109911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqv54" (UID: "642c3171-a34a-4331-b2fd-37e19ba3d385") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:32:57.223138 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:57.223100    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm podName:642c3171-a34a-4331-b2fd-37e19ba3d385 nodeName:}" failed. No retries permitted until 2026-07-13 18:33:01.223081532 +0000 UTC m=+68.310186982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqv54" (UID: "642c3171-a34a-4331-b2fd-37e19ba3d385") : configmap "kube-rbac-proxy" not found
Jul 13 18:32:57.713260 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:57.713221    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qfw8h_06562cd2-d027-4c32-8e76-8f7c5979a38f/serve-healthcheck-canary/0.log"
Jul 13 18:32:57.913036 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:57.913000    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-tbnnd_52a903d7-0e86-4847-ae21-e255302e7dd7/migrator/0.log"
Jul 13 18:32:58.113807 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:58.113729    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-tbnnd_52a903d7-0e86-4847-ae21-e255302e7dd7/graceful-termination/0.log"
Jul 13 18:32:59.143225 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.143193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:32:59.143661 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.143304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:59.145802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.145781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 18:32:59.145907 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.145880    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 18:32:59.153996 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:59.153980    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 18:32:59.154067 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:32:59.154052    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs podName:b3e8e599-4106-42f0-97f1-a35fdf7afc9c nodeName:}" failed. No retries permitted until 2026-07-13 18:34:03.15403352 +0000 UTC m=+130.241138964 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs") pod "network-metrics-daemon-jmmm5" (UID: "b3e8e599-4106-42f0-97f1-a35fdf7afc9c") : secret "metrics-daemon-secret" not found
Jul 13 18:32:59.156159 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.156142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c58fee49-7c00-4083-ab69-fe0b779a3e5f-original-pull-secret\") pod \"global-pull-secret-syncer-8gf7z\" (UID: \"c58fee49-7c00-4083-ab69-fe0b779a3e5f\") " pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:59.244060 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.244025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvz4\" (UniqueName: \"kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4\") pod \"network-check-target-b5qm6\" (UID: \"419152ca-c25c-48c9-9326-7f2e04e4e8aa\") " pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:59.246791 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.246767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzvz4\" (UniqueName: \"kubernetes.io/projected/419152ca-c25c-48c9-9326-7f2e04e4e8aa-kube-api-access-vzvz4\") pod \"network-check-target-b5qm6\" (UID: \"419152ca-c25c-48c9-9326-7f2e04e4e8aa\") " pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:59.371822 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.371782    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gf7z"
Jul 13 18:32:59.380590 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.380557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ql2kw\""
Jul 13 18:32:59.388011 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.387979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:59.507771 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.507728    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8gf7z"]
Jul 13 18:32:59.511221 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:32:59.511193    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58fee49_7c00_4083_ab69_fe0b779a3e5f.slice/crio-5e11366556044bbdc6786f422f7cd7e2ebf8521554d04691de5692d2aabb6ed9 WatchSource:0}: Error finding container 5e11366556044bbdc6786f422f7cd7e2ebf8521554d04691de5692d2aabb6ed9: Status 404 returned error can't find the container with id 5e11366556044bbdc6786f422f7cd7e2ebf8521554d04691de5692d2aabb6ed9
Jul 13 18:32:59.526906 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.526881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b5qm6"]
Jul 13 18:32:59.528712 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:32:59.528687    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419152ca_c25c_48c9_9326_7f2e04e4e8aa.slice/crio-7b69164fc1ebb3448e8fa2509b156aa37eb5105656cfc30d5fd94e6a6b12ae7e WatchSource:0}: Error finding container 7b69164fc1ebb3448e8fa2509b156aa37eb5105656cfc30d5fd94e6a6b12ae7e: Status 404 returned error can't find the container with id 7b69164fc1ebb3448e8fa2509b156aa37eb5105656cfc30d5fd94e6a6b12ae7e
Jul 13 18:32:59.798373 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.798277    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8gf7z" event={"ID":"c58fee49-7c00-4083-ab69-fe0b779a3e5f","Type":"ContainerStarted","Data":"5e11366556044bbdc6786f422f7cd7e2ebf8521554d04691de5692d2aabb6ed9"}
Jul 13 18:32:59.799664 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.799641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b5qm6" event={"ID":"419152ca-c25c-48c9-9326-7f2e04e4e8aa","Type":"ContainerStarted","Data":"f137e98eeb40e01e92ba7c58e5c4449cdd1b401d669b347f5f571e9aba8f789d"}
Jul 13 18:32:59.799773 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.799681    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b5qm6" event={"ID":"419152ca-c25c-48c9-9326-7f2e04e4e8aa","Type":"ContainerStarted","Data":"7b69164fc1ebb3448e8fa2509b156aa37eb5105656cfc30d5fd94e6a6b12ae7e"}
Jul 13 18:32:59.799832 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.799787    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:32:59.815950 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:32:59.815899    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b5qm6" podStartSLOduration=65.81588552 podStartE2EDuration="1m5.81588552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:32:59.815524203 +0000 UTC m=+66.902629679" watchObservedRunningTime="2026-07-13 18:32:59.81588552 +0000 UTC m=+66.902990984"
Jul 13 18:33:01.259638 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:01.259602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:33:01.260112 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:01.259692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:33:01.260112 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:33:01.259781    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:33:01.260112 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:33:01.259819    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 18:33:01.260112 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:33:01.259874    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls podName:642c3171-a34a-4331-b2fd-37e19ba3d385 nodeName:}" failed. No retries permitted until 2026-07-13 18:33:09.259853125 +0000 UTC m=+76.346958571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqv54" (UID: "642c3171-a34a-4331-b2fd-37e19ba3d385") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:33:01.260112 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:33:01.259922    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm podName:642c3171-a34a-4331-b2fd-37e19ba3d385 nodeName:}" failed. No retries permitted until 2026-07-13 18:33:09.25990352 +0000 UTC m=+76.347008984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqv54" (UID: "642c3171-a34a-4331-b2fd-37e19ba3d385") : configmap "kube-rbac-proxy" not found
Jul 13 18:33:01.663635 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:01.663600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:33:01.663635 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:01.663644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:33:01.666601 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:01.666576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478dd6b1-dc33-48b8-a5e7-a34a2039914b-metrics-tls\") pod \"dns-default-vnb7d\" (UID: \"478dd6b1-dc33-48b8-a5e7-a34a2039914b\") " pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:33:01.666725 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:01.666698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") pod \"image-registry-57f98f988d-j6m6r\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") " pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:33:01.843815 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:01.843785    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gx49k\""
Jul 13 18:33:01.851882 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:01.851841    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:33:01.864837 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:01.864813    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tnbnw\""
Jul 13 18:33:01.873033 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:01.872856    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:33:02.055262 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:02.055229    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f98f988d-j6m6r"]
Jul 13 18:33:02.057872 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:33:02.057847    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff079e0_04ae_462d_9820_c501e3fcd0e8.slice/crio-d01a43b49f677192ec0c1b092ab2ecaea1a0603cdb01b4fab1ec6ee319206f88 WatchSource:0}: Error finding container d01a43b49f677192ec0c1b092ab2ecaea1a0603cdb01b4fab1ec6ee319206f88: Status 404 returned error can't find the container with id d01a43b49f677192ec0c1b092ab2ecaea1a0603cdb01b4fab1ec6ee319206f88
Jul 13 18:33:02.068811 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:02.068788    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vnb7d"]
Jul 13 18:33:02.071321 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:33:02.071292    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478dd6b1_dc33_48b8_a5e7_a34a2039914b.slice/crio-84e8a8dd4ba9949cbfc580373f157c497ef164522b15ff13d6d5fd3dba563e84 WatchSource:0}: Error finding container 84e8a8dd4ba9949cbfc580373f157c497ef164522b15ff13d6d5fd3dba563e84: Status 404 returned error can't find the container with id 84e8a8dd4ba9949cbfc580373f157c497ef164522b15ff13d6d5fd3dba563e84
Jul 13 18:33:02.268178 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:02.268089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:33:02.268542 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:33:02.268251    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 18:33:02.268542 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:33:02.268318    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert podName:452e820d-e6a0-4182-acaf-26ac432d9bc9 nodeName:}" failed. No retries permitted until 2026-07-13 18:33:18.268302747 +0000 UTC m=+85.355408190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-g65jc" (UID: "452e820d-e6a0-4182-acaf-26ac432d9bc9") : secret "networking-console-plugin-cert" not found
Jul 13 18:33:02.812983 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:02.812331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r" event={"ID":"9ff079e0-04ae-462d-9820-c501e3fcd0e8","Type":"ContainerStarted","Data":"aa342e6300b920b758027c7a64032c3d8523923dccbc27ce4099498603438b05"}
Jul 13 18:33:02.812983 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:02.812395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r" event={"ID":"9ff079e0-04ae-462d-9820-c501e3fcd0e8","Type":"ContainerStarted","Data":"d01a43b49f677192ec0c1b092ab2ecaea1a0603cdb01b4fab1ec6ee319206f88"}
Jul 13 18:33:02.812983 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:02.812622    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:33:02.814645 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:02.814590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vnb7d" event={"ID":"478dd6b1-dc33-48b8-a5e7-a34a2039914b","Type":"ContainerStarted","Data":"84e8a8dd4ba9949cbfc580373f157c497ef164522b15ff13d6d5fd3dba563e84"}
Jul 13 18:33:02.842704 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:02.841156    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r" podStartSLOduration=68.841132842 podStartE2EDuration="1m8.841132842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:33:02.840284522 +0000 UTC m=+69.927390012" watchObservedRunningTime="2026-07-13 18:33:02.841132842 +0000 UTC m=+69.928238311"
Jul 13 18:33:05.827524 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:05.827404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8gf7z" event={"ID":"c58fee49-7c00-4083-ab69-fe0b779a3e5f","Type":"ContainerStarted","Data":"5e4f078be2b3591ab76f655f379fd39f36d213ae3ff081ffe58c15c743a0fd96"}
Jul 13 18:33:05.829308 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:05.829284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vnb7d" event={"ID":"478dd6b1-dc33-48b8-a5e7-a34a2039914b","Type":"ContainerStarted","Data":"6f236c6f2f24397d9e0b8487f13af680a039e6a204849ab44eec487a35c5057d"}
Jul 13 18:33:05.829423 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:05.829335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vnb7d" event={"ID":"478dd6b1-dc33-48b8-a5e7-a34a2039914b","Type":"ContainerStarted","Data":"d84f3c14db48591e5053a904c9809c7b605edec02ebcce5877d7cee1521f264d"}
Jul 13 18:33:05.829423 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:05.829363    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:33:05.845788 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:05.845742    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8gf7z" podStartSLOduration=65.896615147 podStartE2EDuration="1m11.845724832s" totalImagesPullingTime="5.949109685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:33:05.845463233 +0000 UTC m=+72.932568703" watchObservedRunningTime="2026-07-13 18:33:05.845724832 +0000 UTC m=+72.932830293"
Jul 13 18:33:05.864974 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:05.864931    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vnb7d" podStartSLOduration=33.486097795 podStartE2EDuration="36.864916263s" totalImagesPullingTime="3.378818468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:33:05.863578981 +0000 UTC m=+72.950684456" watchObservedRunningTime="2026-07-13 18:33:05.864916263 +0000 UTC m=+72.952021732"
Jul 13 18:33:07.460080 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:07.460053    2565 scope.go:117] "RemoveContainer" containerID="6c4844326174c848792018d95939f0ff23154b745d92605504966f5a53afde95"
Jul 13 18:33:07.837870 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:07.837796    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:33:07.838226 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:07.838209    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/1.log"
Jul 13 18:33:07.838275 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:07.838244    2565 generic.go:356] "Generic (PLEG): container finished" podID="904aa018-ac3c-4bff-bc2f-e8ec38db5ef1" containerID="d9fccc84756f9164ae28a8edc80518746d67356f2bd79e614ea326937e86a0ae" exitCode=255
Jul 13 18:33:07.838321 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:07.838276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-2vnvh" event={"ID":"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1","Type":"ContainerDied","Data":"d9fccc84756f9164ae28a8edc80518746d67356f2bd79e614ea326937e86a0ae"}
Jul 13 18:33:07.838367 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:07.838345    2565 scope.go:117] "RemoveContainer" containerID="6c4844326174c848792018d95939f0ff23154b745d92605504966f5a53afde95"
Jul 13 18:33:07.838646 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:07.838628    2565 scope.go:117] "RemoveContainer" containerID="d9fccc84756f9164ae28a8edc80518746d67356f2bd79e614ea326937e86a0ae"
Jul 13 18:33:07.838821 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:33:07.838799    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-2vnvh_openshift-console-operator(904aa018-ac3c-4bff-bc2f-e8ec38db5ef1)\"" pod="openshift-console-operator/console-operator-7866497494-2vnvh" podUID="904aa018-ac3c-4bff-bc2f-e8ec38db5ef1"
Jul 13 18:33:08.843308 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:08.843279    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:33:09.328950 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:09.328902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:33:09.329141 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:09.328970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:33:09.329490 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:09.329449    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c3171-a34a-4331-b2fd-37e19ba3d385-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:33:09.331428 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:09.331406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c3171-a34a-4331-b2fd-37e19ba3d385-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqv54\" (UID: \"642c3171-a34a-4331-b2fd-37e19ba3d385\") " pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:33:09.434967 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:09.434935    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bqv54"
Jul 13 18:33:09.564068 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:09.564040    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bqv54"]
Jul 13 18:33:09.566416 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:33:09.566384    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642c3171_a34a_4331_b2fd_37e19ba3d385.slice/crio-4993f995d8c1e7694bc032fb22d9decd69df8a5ee1a15867c80a456123bffdd4 WatchSource:0}: Error finding container 4993f995d8c1e7694bc032fb22d9decd69df8a5ee1a15867c80a456123bffdd4: Status 404 returned error can't find the container with id 4993f995d8c1e7694bc032fb22d9decd69df8a5ee1a15867c80a456123bffdd4
Jul 13 18:33:09.847944 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:09.847910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqv54" event={"ID":"642c3171-a34a-4331-b2fd-37e19ba3d385","Type":"ContainerStarted","Data":"4993f995d8c1e7694bc032fb22d9decd69df8a5ee1a15867c80a456123bffdd4"}
Jul 13 18:33:13.863698 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:13.863611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqv54" event={"ID":"642c3171-a34a-4331-b2fd-37e19ba3d385","Type":"ContainerStarted","Data":"4b95267970108adb03cadf581ed7bd27ae6025596ddea612b6a88e9f75bccd48"}
Jul 13 18:33:14.869396 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:14.869361    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqv54" event={"ID":"642c3171-a34a-4331-b2fd-37e19ba3d385","Type":"ContainerStarted","Data":"e59af8849c63a8caa71428e3e71c3b03b800dbfc5ad96806363b8f36de425196"}
Jul 13 18:33:15.835923 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:15.835890    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vnb7d"
Jul 13 18:33:16.233765 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.233736    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"]
Jul 13 18:33:16.241967 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.241943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"
Jul 13 18:33:16.244669 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.244647    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 18:33:16.245803 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.245777    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cqrlr\""
Jul 13 18:33:16.245803 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.245802    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 13 18:33:16.245975 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.245787    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 18:33:16.246838 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.246819    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 18:33:16.251174 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.251143    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"]
Jul 13 18:33:16.254337 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.254321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.257426 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.257401    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 13 18:33:16.257570 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.257547    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 13 18:33:16.257784 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.257669    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 13 18:33:16.259647 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.259615    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 13 18:33:16.276646 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.276608    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"]
Jul 13 18:33:16.284854 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.284832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0104e121-b45b-4552-a3a4-3ce6d29db521-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c46b48cbd-hmg79\" (UID: \"0104e121-b45b-4552-a3a4-3ce6d29db521\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"
Jul 13 18:33:16.284975 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.284869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.284975 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.284902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-ca\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.284975 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.284927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/270071e2-bed7-496a-938a-df9ba0e2165b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.285097 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.284975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.285097 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.285052    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rdtl\" (UniqueName: \"kubernetes.io/projected/270071e2-bed7-496a-938a-df9ba0e2165b-kube-api-access-7rdtl\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.285188 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.285123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvshf\" (UniqueName: \"kubernetes.io/projected/0104e121-b45b-4552-a3a4-3ce6d29db521-kube-api-access-mvshf\") pod \"managed-serviceaccount-addon-agent-6c46b48cbd-hmg79\" (UID: \"0104e121-b45b-4552-a3a4-3ce6d29db521\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"
Jul 13 18:33:16.285188 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.285163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-hub\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.295938 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.295909    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"]
Jul 13 18:33:16.386052 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.386020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvshf\" (UniqueName: \"kubernetes.io/projected/0104e121-b45b-4552-a3a4-3ce6d29db521-kube-api-access-mvshf\") pod \"managed-serviceaccount-addon-agent-6c46b48cbd-hmg79\" (UID: \"0104e121-b45b-4552-a3a4-3ce6d29db521\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"
Jul 13 18:33:16.386235 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.386068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-hub\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.386235 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.386115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0104e121-b45b-4552-a3a4-3ce6d29db521-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c46b48cbd-hmg79\" (UID: \"0104e121-b45b-4552-a3a4-3ce6d29db521\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"
Jul 13 18:33:16.386235 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.386142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.386235 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.386170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-ca\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.386235 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.386190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/270071e2-bed7-496a-938a-df9ba0e2165b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.386520 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.386238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.386520 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.386270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rdtl\" (UniqueName: \"kubernetes.io/projected/270071e2-bed7-496a-938a-df9ba0e2165b-kube-api-access-7rdtl\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.387457 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.387403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/270071e2-bed7-496a-938a-df9ba0e2165b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.389519 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.389448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-ca\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.389687 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.389638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0104e121-b45b-4552-a3a4-3ce6d29db521-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c46b48cbd-hmg79\" (UID: \"0104e121-b45b-4552-a3a4-3ce6d29db521\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"
Jul 13 18:33:16.389687 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.389659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.389880 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.389797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-hub\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.390223 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.390206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/270071e2-bed7-496a-938a-df9ba0e2165b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.409849 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.409826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rdtl\" (UniqueName: \"kubernetes.io/projected/270071e2-bed7-496a-938a-df9ba0e2165b-kube-api-access-7rdtl\") pod \"cluster-proxy-proxy-agent-945d8b665-xcqw6\" (UID: \"270071e2-bed7-496a-938a-df9ba0e2165b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.410272 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.410252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvshf\" (UniqueName: \"kubernetes.io/projected/0104e121-b45b-4552-a3a4-3ce6d29db521-kube-api-access-mvshf\") pod \"managed-serviceaccount-addon-agent-6c46b48cbd-hmg79\" (UID: \"0104e121-b45b-4552-a3a4-3ce6d29db521\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"
Jul 13 18:33:16.561007 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.560930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"
Jul 13 18:33:16.568351 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.568267    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"
Jul 13 18:33:16.574145 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.574120    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:33:16.574249 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.574200    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:33:16.574549 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.574534    2565 scope.go:117] "RemoveContainer" containerID="d9fccc84756f9164ae28a8edc80518746d67356f2bd79e614ea326937e86a0ae"
Jul 13 18:33:16.574727 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:33:16.574708    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-2vnvh_openshift-console-operator(904aa018-ac3c-4bff-bc2f-e8ec38db5ef1)\"" pod="openshift-console-operator/console-operator-7866497494-2vnvh" podUID="904aa018-ac3c-4bff-bc2f-e8ec38db5ef1"
Jul 13 18:33:16.929146 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.929022    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79"]
Jul 13 18:33:16.931581 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:33:16.931560    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0104e121_b45b_4552_a3a4_3ce6d29db521.slice/crio-d6e3db7194af43b2746df11e676fb4588e915d4380056a53d31ed6bb1da0ef03 WatchSource:0}: Error finding container d6e3db7194af43b2746df11e676fb4588e915d4380056a53d31ed6bb1da0ef03: Status 404 returned error can't find the container with id d6e3db7194af43b2746df11e676fb4588e915d4380056a53d31ed6bb1da0ef03
Jul 13 18:33:16.943248 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:16.943227    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6"]
Jul 13 18:33:16.945920 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:33:16.945896    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod270071e2_bed7_496a_938a_df9ba0e2165b.slice/crio-72ccfec4d7f60037ec57799dd70837596d1bb37851cca082592602c5fa50898a WatchSource:0}: Error finding container 72ccfec4d7f60037ec57799dd70837596d1bb37851cca082592602c5fa50898a: Status 404 returned error can't find the container with id 72ccfec4d7f60037ec57799dd70837596d1bb37851cca082592602c5fa50898a
Jul 13 18:33:17.881038 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:17.880994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqv54" event={"ID":"642c3171-a34a-4331-b2fd-37e19ba3d385","Type":"ContainerStarted","Data":"e7a448d9eacc10f33c3bc61b4e456f99551599affcb4e81ebeaa6de9c1ad6fc5"}
Jul 13 18:33:17.882188 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:17.882165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6" event={"ID":"270071e2-bed7-496a-938a-df9ba0e2165b","Type":"ContainerStarted","Data":"72ccfec4d7f60037ec57799dd70837596d1bb37851cca082592602c5fa50898a"}
Jul 13 18:33:17.883070 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:17.883050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79" event={"ID":"0104e121-b45b-4552-a3a4-3ce6d29db521","Type":"ContainerStarted","Data":"d6e3db7194af43b2746df11e676fb4588e915d4380056a53d31ed6bb1da0ef03"}
Jul 13 18:33:17.901514 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:17.901452    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bqv54" podStartSLOduration=17.750259217 podStartE2EDuration="24.901435209s" totalImagesPullingTime="7.151175992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:32:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:33:17.901221768 +0000 UTC m=+84.988327252" watchObservedRunningTime="2026-07-13 18:33:17.901435209 +0000 UTC m=+84.988540675"
Jul 13 18:33:18.303155 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:18.303116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:33:18.306045 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:18.306018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/452e820d-e6a0-4182-acaf-26ac432d9bc9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-g65jc\" (UID: \"452e820d-e6a0-4182-acaf-26ac432d9bc9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:33:18.569013 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:18.568928    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kf2qh\""
Jul 13 18:33:18.574752 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:18.574737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc"
Jul 13 18:33:18.707524 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:18.707499    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-g65jc"]
Jul 13 18:33:18.710015 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:33:18.709986    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452e820d_e6a0_4182_acaf_26ac432d9bc9.slice/crio-1ee07b2a0327513ce26ecc9ee1a63295074cafd008dcbf246e1a7a2d2ef23fd9 WatchSource:0}: Error finding container 1ee07b2a0327513ce26ecc9ee1a63295074cafd008dcbf246e1a7a2d2ef23fd9: Status 404 returned error can't find the container with id 1ee07b2a0327513ce26ecc9ee1a63295074cafd008dcbf246e1a7a2d2ef23fd9
Jul 13 18:33:18.887574 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:18.887488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc" event={"ID":"452e820d-e6a0-4182-acaf-26ac432d9bc9","Type":"ContainerStarted","Data":"1ee07b2a0327513ce26ecc9ee1a63295074cafd008dcbf246e1a7a2d2ef23fd9"}
Jul 13 18:33:21.857346 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:21.857302    2565 patch_prober.go:28] interesting pod/image-registry-57f98f988d-j6m6r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 18:33:21.857815 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:21.857378    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r" podUID="9ff079e0-04ae-462d-9820-c501e3fcd0e8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 18:33:22.908520 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:22.908462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79" event={"ID":"0104e121-b45b-4552-a3a4-3ce6d29db521","Type":"ContainerStarted","Data":"7069e54be04ef4b672d082e077c8e2f2bf770a90a5d0199f458c22f96232042b"}
Jul 13 18:33:22.910004 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:22.909973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc" event={"ID":"452e820d-e6a0-4182-acaf-26ac432d9bc9","Type":"ContainerStarted","Data":"522e42e8c799850d5021ace968339aa90f8c27606a60fd914f59a8b0ca119b05"}
Jul 13 18:33:22.926747 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:22.926696    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c46b48cbd-hmg79" podStartSLOduration=1.484482183 podStartE2EDuration="6.926676987s" totalImagesPullingTime="5.442194804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:33:22.924602274 +0000 UTC m=+90.011707739" watchObservedRunningTime="2026-07-13 18:33:22.926676987 +0000 UTC m=+90.013782453"
Jul 13 18:33:22.948816 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:22.948769    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-g65jc" podStartSLOduration=33.579260438 podStartE2EDuration="36.948751356s" totalImagesPullingTime="3.369490918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:33:22.947998595 +0000 UTC m=+90.035104081" watchObservedRunningTime="2026-07-13 18:33:22.948751356 +0000 UTC m=+90.035856822"
Jul 13 18:33:23.823851 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:23.823814    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:33:24.927794 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:24.927758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6" event={"ID":"270071e2-bed7-496a-938a-df9ba0e2165b","Type":"ContainerStarted","Data":"26a1024571bc3a7e4ff95239b82a854db45d57707c1a49e75e2c9d7e08a08776"}
Jul 13 18:33:24.928277 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:24.927808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6" event={"ID":"270071e2-bed7-496a-938a-df9ba0e2165b","Type":"ContainerStarted","Data":"e7f060f986d83b1490d92c867bdf0addeccd62ee6f98cd336d5cfb7d19e6a2f2"}
Jul 13 18:33:24.928277 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:24.927833    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6" event={"ID":"270071e2-bed7-496a-938a-df9ba0e2165b","Type":"ContainerStarted","Data":"fe27f3ce430b17fe4bda545ae5a987797bac8f4e4d3096235eaac5d7ca042312"}
Jul 13 18:33:24.956539 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:24.956491    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-945d8b665-xcqw6" podStartSLOduration=1.319485685 podStartE2EDuration="8.956457975s" totalImagesPullingTime="7.63697229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:33:24.954865678 +0000 UTC m=+92.041971143" watchObservedRunningTime="2026-07-13 18:33:24.956457975 +0000 UTC m=+92.043563470"
Jul 13 18:33:30.806088 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:30.806058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b5qm6"
Jul 13 18:33:32.460172 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:32.460137    2565 scope.go:117] "RemoveContainer" containerID="d9fccc84756f9164ae28a8edc80518746d67356f2bd79e614ea326937e86a0ae"
Jul 13 18:33:32.955284 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:32.955253    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:33:32.955450 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:32.955316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-2vnvh" event={"ID":"904aa018-ac3c-4bff-bc2f-e8ec38db5ef1","Type":"ContainerStarted","Data":"9078fa509ff000d194773b96461a7a625cf5eaf74a1330f7bf705b363a88e180"}
Jul 13 18:33:32.955624 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:32.955596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:33:32.997245 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:32.997193    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-2vnvh" podStartSLOduration=42.336272535 podStartE2EDuration="46.997176378s" totalImagesPullingTime="4.660903843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:33:32.995982153 +0000 UTC m=+100.083087617" watchObservedRunningTime="2026-07-13 18:33:32.997176378 +0000 UTC m=+100.084281842"
Jul 13 18:33:33.223415 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.223344    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-2vnvh"
Jul 13 18:33:33.732498 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.729625    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tftqq"]
Jul 13 18:33:33.733573 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.733551    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.741497 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.741460    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 18:33:33.742485 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.742455    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 18:33:33.742574 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.742555    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jxvkr\""
Jul 13 18:33:33.742650 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.742598    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 18:33:33.743846 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.743821    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 18:33:33.743846 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.743832    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 18:33:33.744398 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.744383    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 18:33:33.836753 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.836718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.836928 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.836773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-sys\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.836928 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.836797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-textfile\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.836928 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.836823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-root\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.836928 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.836866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.836928 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.836900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-tls\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.836928 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.836926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-wtmp\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.837138 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.837015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-metrics-client-ca\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.837138 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.837079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbn67\" (UniqueName: \"kubernetes.io/projected/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-kube-api-access-bbn67\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.937634 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.937812 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-tls\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.937812 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-wtmp\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.937812 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-metrics-client-ca\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.937812 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbn67\" (UniqueName: \"kubernetes.io/projected/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-kube-api-access-bbn67\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.937812 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.937812 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-sys\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.938111 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-wtmp\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.938111 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-sys\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.938111 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-textfile\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.938111 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.937925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-root\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.938111 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.938060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-root\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.938342 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.938234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-textfile\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.938342 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.938328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-metrics-client-ca\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.938633 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.938610    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.940104 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.940082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-tls\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.940196 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.940123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:33.968090 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:33.968060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbn67\" (UniqueName: \"kubernetes.io/projected/ff44152e-c4f5-44ff-b7f7-923a8e8babc2-kube-api-access-bbn67\") pod \"node-exporter-tftqq\" (UID: \"ff44152e-c4f5-44ff-b7f7-923a8e8babc2\") " pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:34.042940 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:34.042852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tftqq"
Jul 13 18:33:34.053035 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:33:34.053010    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff44152e_c4f5_44ff_b7f7_923a8e8babc2.slice/crio-ac2935237b72520b9b76f49269c4792c60340c12276e02486b412185f3369d61 WatchSource:0}: Error finding container ac2935237b72520b9b76f49269c4792c60340c12276e02486b412185f3369d61: Status 404 returned error can't find the container with id ac2935237b72520b9b76f49269c4792c60340c12276e02486b412185f3369d61
Jul 13 18:33:34.963267 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:34.963232    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tftqq" event={"ID":"ff44152e-c4f5-44ff-b7f7-923a8e8babc2","Type":"ContainerStarted","Data":"ac2935237b72520b9b76f49269c4792c60340c12276e02486b412185f3369d61"}
Jul 13 18:33:36.972244 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:36.972209    2565 generic.go:356] "Generic (PLEG): container finished" podID="ff44152e-c4f5-44ff-b7f7-923a8e8babc2" containerID="ffc0b496f1385e12cd25d52b82354c392c50c32a777f544b9406d6a9353a2a88" exitCode=0
Jul 13 18:33:36.972685 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:36.972294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tftqq" event={"ID":"ff44152e-c4f5-44ff-b7f7-923a8e8babc2","Type":"ContainerDied","Data":"ffc0b496f1385e12cd25d52b82354c392c50c32a777f544b9406d6a9353a2a88"}
Jul 13 18:33:37.978851 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:37.978814    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tftqq" event={"ID":"ff44152e-c4f5-44ff-b7f7-923a8e8babc2","Type":"ContainerStarted","Data":"0fa5e13b307c21a1f7eb8a0fab643ac05712ca85cfa5505927d6e677d1cac2b3"}
Jul 13 18:33:37.979248 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:37.978873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tftqq" event={"ID":"ff44152e-c4f5-44ff-b7f7-923a8e8babc2","Type":"ContainerStarted","Data":"d5461c13fcf218734a819cce5833926d8ac5189c8e06e636796876b7fe2f056c"}
Jul 13 18:33:38.024414 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:38.024348    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tftqq" podStartSLOduration=2.876310152 podStartE2EDuration="5.024325887s" totalImagesPullingTime="2.038214028s" totalInitContainerRuntime="109.801707ms" isStatefulPod=true podCreationTimestamp="2026-07-13 18:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:33:38.022226155 +0000 UTC m=+105.109331644" watchObservedRunningTime="2026-07-13 18:33:38.024325887 +0000 UTC m=+105.111431354"
Jul 13 18:33:38.833198 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:33:38.833142    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57f98f988d-j6m6r"]
Jul 13 18:34:03.177480 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:03.177424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:34:03.179942 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:03.179921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e8e599-4106-42f0-97f1-a35fdf7afc9c-metrics-certs\") pod \"network-metrics-daemon-jmmm5\" (UID: \"b3e8e599-4106-42f0-97f1-a35fdf7afc9c\") " pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:34:03.286082 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:03.286050    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwd4z\""
Jul 13 18:34:03.293548 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:03.293516    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmmm5"
Jul 13 18:34:03.438365 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:03.438343    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jmmm5"]
Jul 13 18:34:03.440815 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:34:03.440779    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e8e599_4106_42f0_97f1_a35fdf7afc9c.slice/crio-0a541dfe9f5a1672a4467c2075b80c29402e53afe1cdc71cacfe4fa05c489df1 WatchSource:0}: Error finding container 0a541dfe9f5a1672a4467c2075b80c29402e53afe1cdc71cacfe4fa05c489df1: Status 404 returned error can't find the container with id 0a541dfe9f5a1672a4467c2075b80c29402e53afe1cdc71cacfe4fa05c489df1
Jul 13 18:34:03.859220 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:03.859091    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r" podUID="9ff079e0-04ae-462d-9820-c501e3fcd0e8" containerName="registry" containerID="cri-o://aa342e6300b920b758027c7a64032c3d8523923dccbc27ce4099498603438b05" gracePeriod=30
Jul 13 18:34:04.071242 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.071040    2565 generic.go:356] "Generic (PLEG): container finished" podID="9ff079e0-04ae-462d-9820-c501e3fcd0e8" containerID="aa342e6300b920b758027c7a64032c3d8523923dccbc27ce4099498603438b05" exitCode=0
Jul 13 18:34:04.071242 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.071123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r" event={"ID":"9ff079e0-04ae-462d-9820-c501e3fcd0e8","Type":"ContainerDied","Data":"aa342e6300b920b758027c7a64032c3d8523923dccbc27ce4099498603438b05"}
Jul 13 18:34:04.081268 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.081172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jmmm5" event={"ID":"b3e8e599-4106-42f0-97f1-a35fdf7afc9c","Type":"ContainerStarted","Data":"0a541dfe9f5a1672a4467c2075b80c29402e53afe1cdc71cacfe4fa05c489df1"}
Jul 13 18:34:04.321700 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.321672    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:34:04.384779 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.384750    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtpmq\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-kube-api-access-wtpmq\") pod \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") "
Jul 13 18:34:04.384932 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.384798    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-bound-sa-token\") pod \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") "
Jul 13 18:34:04.384932 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.384824    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ff079e0-04ae-462d-9820-c501e3fcd0e8-ca-trust-extracted\") pod \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") "
Jul 13 18:34:04.384932 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.384843    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-trusted-ca\") pod \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") "
Jul 13 18:34:04.384932 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.384863    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-certificates\") pod \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") "
Jul 13 18:34:04.384932 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.384884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-image-registry-private-configuration\") pod \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") "
Jul 13 18:34:04.385122 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.384990    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-installation-pull-secrets\") pod \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") "
Jul 13 18:34:04.385122 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.385047    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") pod \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\" (UID: \"9ff079e0-04ae-462d-9820-c501e3fcd0e8\") "
Jul 13 18:34:04.385369 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.385340    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9ff079e0-04ae-462d-9820-c501e3fcd0e8" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:34:04.387529 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.386007    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9ff079e0-04ae-462d-9820-c501e3fcd0e8" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:34:04.388011 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.387983    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-kube-api-access-wtpmq" (OuterVolumeSpecName: "kube-api-access-wtpmq") pod "9ff079e0-04ae-462d-9820-c501e3fcd0e8" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8"). InnerVolumeSpecName "kube-api-access-wtpmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:34:04.388109 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.388022    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9ff079e0-04ae-462d-9820-c501e3fcd0e8" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:34:04.388294 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.388273    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9ff079e0-04ae-462d-9820-c501e3fcd0e8" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:34:04.388381 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.388293    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9ff079e0-04ae-462d-9820-c501e3fcd0e8" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:34:04.388434 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.388390    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9ff079e0-04ae-462d-9820-c501e3fcd0e8" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:34:04.394877 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.394848    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff079e0-04ae-462d-9820-c501e3fcd0e8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9ff079e0-04ae-462d-9820-c501e3fcd0e8" (UID: "9ff079e0-04ae-462d-9820-c501e3fcd0e8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:34:04.486190 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.486152    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtpmq\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-kube-api-access-wtpmq\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:34:04.486190 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.486189    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-bound-sa-token\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:34:04.486353 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.486207    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ff079e0-04ae-462d-9820-c501e3fcd0e8-ca-trust-extracted\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:34:04.486353 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.486221    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-trusted-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:34:04.486353 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.486235    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-certificates\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:34:04.486353 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.486249    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-image-registry-private-configuration\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:34:04.486353 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.486262    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ff079e0-04ae-462d-9820-c501e3fcd0e8-installation-pull-secrets\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:34:04.486353 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:04.486275    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff079e0-04ae-462d-9820-c501e3fcd0e8-registry-tls\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:34:05.086380 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:05.086351    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r"
Jul 13 18:34:05.086593 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:05.086352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f98f988d-j6m6r" event={"ID":"9ff079e0-04ae-462d-9820-c501e3fcd0e8","Type":"ContainerDied","Data":"d01a43b49f677192ec0c1b092ab2ecaea1a0603cdb01b4fab1ec6ee319206f88"}
Jul 13 18:34:05.086593 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:05.086526    2565 scope.go:117] "RemoveContainer" containerID="aa342e6300b920b758027c7a64032c3d8523923dccbc27ce4099498603438b05"
Jul 13 18:34:05.088388 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:05.088364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jmmm5" event={"ID":"b3e8e599-4106-42f0-97f1-a35fdf7afc9c","Type":"ContainerStarted","Data":"c062bb74c98b71de5440518f2da8e8eb40e7d69f2a4e8b32baa3a4afb478e3d0"}
Jul 13 18:34:05.088524 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:05.088406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jmmm5" event={"ID":"b3e8e599-4106-42f0-97f1-a35fdf7afc9c","Type":"ContainerStarted","Data":"991b20cfa14018ee806553ae4f3fce71018d5a7db65367cc13962da13ee54f9d"}
Jul 13 18:34:05.114180 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:05.114137    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jmmm5" podStartSLOduration=130.223781326 podStartE2EDuration="2m11.114122558s" totalImagesPullingTime="890.341232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:34:05.113430965 +0000 UTC m=+132.200536430" watchObservedRunningTime="2026-07-13 18:34:05.114122558 +0000 UTC m=+132.201228023"
Jul 13 18:34:05.147658 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:05.147627    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57f98f988d-j6m6r"]
Jul 13 18:34:05.164172 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:05.164146    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57f98f988d-j6m6r"]
Jul 13 18:34:05.463989 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:05.463960    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff079e0-04ae-462d-9820-c501e3fcd0e8" path="/var/lib/kubelet/pods/9ff079e0-04ae-462d-9820-c501e3fcd0e8/volumes"
Jul 13 18:34:23.157162 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:23.157133    2565 generic.go:356] "Generic (PLEG): container finished" podID="db843a09-1042-4247-81c9-25bf59b3bb27" containerID="44430eedc354aa41b90d1d1efba383786dcc456bf1a34548871acb425a707778" exitCode=0
Jul 13 18:34:23.157626 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:23.157207    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-clkzx" event={"ID":"db843a09-1042-4247-81c9-25bf59b3bb27","Type":"ContainerDied","Data":"44430eedc354aa41b90d1d1efba383786dcc456bf1a34548871acb425a707778"}
Jul 13 18:34:23.157626 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:23.157612    2565 scope.go:117] "RemoveContainer" containerID="44430eedc354aa41b90d1d1efba383786dcc456bf1a34548871acb425a707778"
Jul 13 18:34:23.158920 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:23.158898    2565 generic.go:356] "Generic (PLEG): container finished" podID="d8bb9ff9-4849-4cc2-a2a5-b3436ee78780" containerID="15eacc2d47def63ae74708e323415ce135c2a505d2afe65414a66280a1600f28" exitCode=0
Jul 13 18:34:23.159008 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:23.158957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg" event={"ID":"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780","Type":"ContainerDied","Data":"15eacc2d47def63ae74708e323415ce135c2a505d2afe65414a66280a1600f28"}
Jul 13 18:34:23.159258 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:23.159240    2565 scope.go:117] "RemoveContainer" containerID="15eacc2d47def63ae74708e323415ce135c2a505d2afe65414a66280a1600f28"
Jul 13 18:34:24.165132 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:24.165100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xbrgg" event={"ID":"d8bb9ff9-4849-4cc2-a2a5-b3436ee78780","Type":"ContainerStarted","Data":"25dae8f61754e750c2bac22901e3eb2453ff1fb998f2e37902001054d9620aed"}
Jul 13 18:34:24.166996 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:34:24.166973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-clkzx" event={"ID":"db843a09-1042-4247-81c9-25bf59b3bb27","Type":"ContainerStarted","Data":"bb2dad7435a46ebbd3ba926da172a778e436435fd0476f5c53c5920ff7c0f319"}
Jul 13 18:36:53.277834 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:36:53.277808    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:36:53.282842 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:36:53.282821    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:36:53.283874 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:36:53.283853    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:36:53.288048 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:36:53.288028    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 18:36:53.289665 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:36:53.289641    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:38:21.218209 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.218173    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"]
Jul 13 18:38:21.218697 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.218443    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff079e0-04ae-462d-9820-c501e3fcd0e8" containerName="registry"
Jul 13 18:38:21.218697 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.218453    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff079e0-04ae-462d-9820-c501e3fcd0e8" containerName="registry"
Jul 13 18:38:21.218697 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.218522    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff079e0-04ae-462d-9820-c501e3fcd0e8" containerName="registry"
Jul 13 18:38:21.220532 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.220515    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.224508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.224484    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jppj5\""
Jul 13 18:38:21.224686 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.224557    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:38:21.224686 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.224506    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 18:38:21.224686 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.224508    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 18:38:21.224686 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.224593    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 18:38:21.224686 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.224506    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 18:38:21.232539 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.232513    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"]
Jul 13 18:38:21.284992 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.284946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7m9r\" (UniqueName: \"kubernetes.io/projected/19b68333-9e99-4f9f-95ce-6a232d2dc74f-kube-api-access-s7m9r\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.285176 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.285008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19b68333-9e99-4f9f-95ce-6a232d2dc74f-manager-config\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.285176 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.285085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19b68333-9e99-4f9f-95ce-6a232d2dc74f-cert\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.285176 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.285124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19b68333-9e99-4f9f-95ce-6a232d2dc74f-metrics-cert\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.386372 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.386329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19b68333-9e99-4f9f-95ce-6a232d2dc74f-cert\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.386372 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.386378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19b68333-9e99-4f9f-95ce-6a232d2dc74f-metrics-cert\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.386648 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.386410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7m9r\" (UniqueName: \"kubernetes.io/projected/19b68333-9e99-4f9f-95ce-6a232d2dc74f-kube-api-access-s7m9r\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.386648 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.386442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19b68333-9e99-4f9f-95ce-6a232d2dc74f-manager-config\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.387136 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.387110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19b68333-9e99-4f9f-95ce-6a232d2dc74f-manager-config\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.389007 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.388983    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19b68333-9e99-4f9f-95ce-6a232d2dc74f-cert\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.389098 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.389016    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19b68333-9e99-4f9f-95ce-6a232d2dc74f-metrics-cert\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.396011 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.395987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7m9r\" (UniqueName: \"kubernetes.io/projected/19b68333-9e99-4f9f-95ce-6a232d2dc74f-kube-api-access-s7m9r\") pod \"lws-controller-manager-7f7b869d75-rkl6d\" (UID: \"19b68333-9e99-4f9f-95ce-6a232d2dc74f\") " pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.531623 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.531543    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:21.658659 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.658616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"]
Jul 13 18:38:21.663064 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:38:21.663021    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b68333_9e99_4f9f_95ce_6a232d2dc74f.slice/crio-8f95cebfcbc380f541b9a9489aaff3f4335ccb8218ee4d94be76d24448a959a5 WatchSource:0}: Error finding container 8f95cebfcbc380f541b9a9489aaff3f4335ccb8218ee4d94be76d24448a959a5: Status 404 returned error can't find the container with id 8f95cebfcbc380f541b9a9489aaff3f4335ccb8218ee4d94be76d24448a959a5
Jul 13 18:38:21.664908 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:21.664893    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 18:38:22.018224 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:22.018191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d" event={"ID":"19b68333-9e99-4f9f-95ce-6a232d2dc74f","Type":"ContainerStarted","Data":"8f95cebfcbc380f541b9a9489aaff3f4335ccb8218ee4d94be76d24448a959a5"}
Jul 13 18:38:26.036773 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:26.036736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d" event={"ID":"19b68333-9e99-4f9f-95ce-6a232d2dc74f","Type":"ContainerStarted","Data":"60e56df694346a4cef79fbf94cd759aa8f1c66ab43d77119a1514c8317416f08"}
Jul 13 18:38:26.037222 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:26.036878    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:26.058540 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:26.058489    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d" podStartSLOduration=1.746946804 podStartE2EDuration="5.058452038s" totalImagesPullingTime="3.311505234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:38:26.057933496 +0000 UTC m=+393.145038965" watchObservedRunningTime="2026-07-13 18:38:26.058452038 +0000 UTC m=+393.145557504"
Jul 13 18:38:29.808035 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.808003    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"]
Jul 13 18:38:29.810314 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.810298    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.813606 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.813584    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 18:38:29.813823 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.813807    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 18:38:29.813910 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.813827    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vdvqz\""
Jul 13 18:38:29.813968 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.813924    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 18:38:29.814133 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.814118    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 18:38:29.829930 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.829907    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"]
Jul 13 18:38:29.858525 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.858501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7zrb\" (UniqueName: \"kubernetes.io/projected/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-kube-api-access-s7zrb\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.858641 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.858536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-tmp\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.858641 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.858555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.858760 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.858672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.858760 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.858738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-manifests\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.959765 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.959740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-manifests\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.959906 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.959773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zrb\" (UniqueName: \"kubernetes.io/projected/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-kube-api-access-s7zrb\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.959906 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.959799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-tmp\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.960018 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.959918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.960018 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.959983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.960174 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.960146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-manifests\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.962086 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.962059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-tmp\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.962375 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.962355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.962437 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.962370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:29.970926 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:29.970905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7zrb\" (UniqueName: \"kubernetes.io/projected/59d64478-93f5-4d2a-af24-de5bfd2e2cf6-kube-api-access-s7zrb\") pod \"opendatahub-operator-controller-manager-b4789cfbf-p44nd\" (UID: \"59d64478-93f5-4d2a-af24-de5bfd2e2cf6\") " pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:30.120008 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:30.119934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:30.276667 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:30.276617    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"]
Jul 13 18:38:30.280712 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:38:30.280685    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d64478_93f5_4d2a_af24_de5bfd2e2cf6.slice/crio-94e755b153e411665e5df9822e11fb2d8cdcd624b13afffd2e67281e3883051a WatchSource:0}: Error finding container 94e755b153e411665e5df9822e11fb2d8cdcd624b13afffd2e67281e3883051a: Status 404 returned error can't find the container with id 94e755b153e411665e5df9822e11fb2d8cdcd624b13afffd2e67281e3883051a
Jul 13 18:38:31.057575 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:31.057524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd" event={"ID":"59d64478-93f5-4d2a-af24-de5bfd2e2cf6","Type":"ContainerStarted","Data":"94e755b153e411665e5df9822e11fb2d8cdcd624b13afffd2e67281e3883051a"}
Jul 13 18:38:34.073097 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:34.073055    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd" event={"ID":"59d64478-93f5-4d2a-af24-de5bfd2e2cf6","Type":"ContainerStarted","Data":"d577defda485fa4c9409d17d8826db22f599187ea40165fc86be6285b6a6d2b5"}
Jul 13 18:38:35.078951 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:35.078914    2565 generic.go:356] "Generic (PLEG): container finished" podID="59d64478-93f5-4d2a-af24-de5bfd2e2cf6" containerID="d577defda485fa4c9409d17d8826db22f599187ea40165fc86be6285b6a6d2b5" exitCode=0
Jul 13 18:38:35.079417 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:35.078980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd" event={"ID":"59d64478-93f5-4d2a-af24-de5bfd2e2cf6","Type":"ContainerDied","Data":"d577defda485fa4c9409d17d8826db22f599187ea40165fc86be6285b6a6d2b5"}
Jul 13 18:38:36.085583 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:36.085548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd" event={"ID":"59d64478-93f5-4d2a-af24-de5bfd2e2cf6","Type":"ContainerStarted","Data":"1c82ab7253563764004e8f9ca44e73c6366c57df4ab1a56c9cce261fc753213a"}
Jul 13 18:38:36.085962 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:36.085649    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:38:36.116569 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:36.116514    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd" podStartSLOduration=2.642585809 podStartE2EDuration="7.116498468s" totalImagesPullingTime="3.39627688s" totalInitContainerRuntime="1.077635779s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:38:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:38:36.113739338 +0000 UTC m=+403.200844802" watchObservedRunningTime="2026-07-13 18:38:36.116498468 +0000 UTC m=+403.203603931"
Jul 13 18:38:37.042396 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:37.042367    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f7b869d75-rkl6d"
Jul 13 18:38:47.092820 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:38:47.092790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b4789cfbf-p44nd"
Jul 13 18:39:09.748446 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.748413    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"]
Jul 13 18:39:09.756651 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.756630    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.759968 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.759947    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 18:39:09.760934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.760918    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 18:39:09.762418 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.762400    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 18:39:09.763242 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.763220    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-784rl\""
Jul 13 18:39:09.773755 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.773722    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"]
Jul 13 18:39:09.891568 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.891530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.891568 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.891571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.891797 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.891589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.891797 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.891697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.891797 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.891757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.891909 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.891832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.891909 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.891857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmg2x\" (UniqueName: \"kubernetes.io/projected/310a469f-1c7f-41db-9676-3fd56f3a1fe8-kube-api-access-xmg2x\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.891909 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.891898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.892010 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.891945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.992701 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.992658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.992701 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.992695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmg2x\" (UniqueName: \"kubernetes.io/projected/310a469f-1c7f-41db-9676-3fd56f3a1fe8-kube-api-access-xmg2x\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.992948 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.992720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.992948 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.992750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.992948 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.992777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.992948 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.992807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.992948 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.992833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.992948 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.992862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.992948 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.992890    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.993331 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.993216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.993390 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.993328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.993390 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.993366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.993501 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.993387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.993863 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.993841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.995232 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.995212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:09.995483 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:09.995446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:10.005370 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:10.005317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/310a469f-1c7f-41db-9676-3fd56f3a1fe8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:10.005812 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:10.005792    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmg2x\" (UniqueName: \"kubernetes.io/projected/310a469f-1c7f-41db-9676-3fd56f3a1fe8-kube-api-access-xmg2x\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvtgm\" (UID: \"310a469f-1c7f-41db-9676-3fd56f3a1fe8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:10.067690 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:10.067639    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:10.199694 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:10.199667    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"]
Jul 13 18:39:10.201686 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:39:10.201656    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310a469f_1c7f_41db_9676_3fd56f3a1fe8.slice/crio-dafdda71d2cfdb3bcc95eda93bd839b941538c75fc3eb39138379f3f93d3a801 WatchSource:0}: Error finding container dafdda71d2cfdb3bcc95eda93bd839b941538c75fc3eb39138379f3f93d3a801: Status 404 returned error can't find the container with id dafdda71d2cfdb3bcc95eda93bd839b941538c75fc3eb39138379f3f93d3a801
Jul 13 18:39:10.220361 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:10.220334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm" event={"ID":"310a469f-1c7f-41db-9676-3fd56f3a1fe8","Type":"ContainerStarted","Data":"dafdda71d2cfdb3bcc95eda93bd839b941538c75fc3eb39138379f3f93d3a801"}
Jul 13 18:39:18.574882 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:18.574844    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:39:18.575165 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:18.574919    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:39:18.575165 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:18.574947    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:39:19.256920 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:19.256883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm" event={"ID":"310a469f-1c7f-41db-9676-3fd56f3a1fe8","Type":"ContainerStarted","Data":"a8de406cceb0d27489901f99d6fb9440eb94f8f95c9d76dd0d80b124b640c8f9"}
Jul 13 18:39:19.280425 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:19.280376    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm" podStartSLOduration=1.9093481730000001 podStartE2EDuration="10.280360791s" totalImagesPullingTime="8.371012618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:39:19.280109309 +0000 UTC m=+446.367214791" watchObservedRunningTime="2026-07-13 18:39:19.280360791 +0000 UTC m=+446.367466258"
Jul 13 18:39:20.068012 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:20.067970    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:20.072556 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:20.072534    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:20.261097 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:20.261061    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:20.261992 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:20.261971    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvtgm"
Jul 13 18:39:50.533312 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.533277    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6k8vw"]
Jul 13 18:39:50.535406 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.535390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6k8vw"
Jul 13 18:39:50.538609 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.538583    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jmgvl\""
Jul 13 18:39:50.539419 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.539394    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 18:39:50.539564 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.539433    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 18:39:50.552931 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.552907    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6k8vw"]
Jul 13 18:39:50.606287 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.606253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xzxp\" (UniqueName: \"kubernetes.io/projected/3c0f7e67-f2b0-41a0-af6e-4814f288038e-kube-api-access-6xzxp\") pod \"kuadrant-operator-catalog-6k8vw\" (UID: \"3c0f7e67-f2b0-41a0-af6e-4814f288038e\") " pod="kuadrant-system/kuadrant-operator-catalog-6k8vw"
Jul 13 18:39:50.707660 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.707628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xzxp\" (UniqueName: \"kubernetes.io/projected/3c0f7e67-f2b0-41a0-af6e-4814f288038e-kube-api-access-6xzxp\") pod \"kuadrant-operator-catalog-6k8vw\" (UID: \"3c0f7e67-f2b0-41a0-af6e-4814f288038e\") " pod="kuadrant-system/kuadrant-operator-catalog-6k8vw"
Jul 13 18:39:50.717515 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.717483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xzxp\" (UniqueName: \"kubernetes.io/projected/3c0f7e67-f2b0-41a0-af6e-4814f288038e-kube-api-access-6xzxp\") pod \"kuadrant-operator-catalog-6k8vw\" (UID: \"3c0f7e67-f2b0-41a0-af6e-4814f288038e\") " pod="kuadrant-system/kuadrant-operator-catalog-6k8vw"
Jul 13 18:39:50.845969 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.845868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6k8vw"
Jul 13 18:39:50.882372 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.882335    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6k8vw"]
Jul 13 18:39:50.973351 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:50.973201    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6k8vw"]
Jul 13 18:39:50.975922 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:39:50.975887    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0f7e67_f2b0_41a0_af6e_4814f288038e.slice/crio-bfc942ec618d588829c65a4399633cfcf4506a1116f57306c3f335f896e100a2 WatchSource:0}: Error finding container bfc942ec618d588829c65a4399633cfcf4506a1116f57306c3f335f896e100a2: Status 404 returned error can't find the container with id bfc942ec618d588829c65a4399633cfcf4506a1116f57306c3f335f896e100a2
Jul 13 18:39:51.094565 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:51.094531    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sc74n"]
Jul 13 18:39:51.100170 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:51.100115    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sc74n"
Jul 13 18:39:51.105347 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:51.105322    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sc74n"]
Jul 13 18:39:51.211068 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:51.211037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqqbg\" (UniqueName: \"kubernetes.io/projected/0978beff-7740-45b1-b2e1-0df62797fc3a-kube-api-access-rqqbg\") pod \"kuadrant-operator-catalog-sc74n\" (UID: \"0978beff-7740-45b1-b2e1-0df62797fc3a\") " pod="kuadrant-system/kuadrant-operator-catalog-sc74n"
Jul 13 18:39:51.311500 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:51.311450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqbg\" (UniqueName: \"kubernetes.io/projected/0978beff-7740-45b1-b2e1-0df62797fc3a-kube-api-access-rqqbg\") pod \"kuadrant-operator-catalog-sc74n\" (UID: \"0978beff-7740-45b1-b2e1-0df62797fc3a\") " pod="kuadrant-system/kuadrant-operator-catalog-sc74n"
Jul 13 18:39:51.319297 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:51.319269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqbg\" (UniqueName: \"kubernetes.io/projected/0978beff-7740-45b1-b2e1-0df62797fc3a-kube-api-access-rqqbg\") pod \"kuadrant-operator-catalog-sc74n\" (UID: \"0978beff-7740-45b1-b2e1-0df62797fc3a\") " pod="kuadrant-system/kuadrant-operator-catalog-sc74n"
Jul 13 18:39:51.386860 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:51.386791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6k8vw" event={"ID":"3c0f7e67-f2b0-41a0-af6e-4814f288038e","Type":"ContainerStarted","Data":"bfc942ec618d588829c65a4399633cfcf4506a1116f57306c3f335f896e100a2"}
Jul 13 18:39:51.410045 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:51.410012    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sc74n"
Jul 13 18:39:51.562304 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:51.562151    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sc74n"]
Jul 13 18:39:51.581927 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:39:51.581882    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0978beff_7740_45b1_b2e1_0df62797fc3a.slice/crio-f2f800c86602208c37d954ed2af18ba5fa071f499b29f650325ffeb33ae81fca WatchSource:0}: Error finding container f2f800c86602208c37d954ed2af18ba5fa071f499b29f650325ffeb33ae81fca: Status 404 returned error can't find the container with id f2f800c86602208c37d954ed2af18ba5fa071f499b29f650325ffeb33ae81fca
Jul 13 18:39:52.393545 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:52.393504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sc74n" event={"ID":"0978beff-7740-45b1-b2e1-0df62797fc3a","Type":"ContainerStarted","Data":"f2f800c86602208c37d954ed2af18ba5fa071f499b29f650325ffeb33ae81fca"}
Jul 13 18:39:53.400592 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:53.400549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sc74n" event={"ID":"0978beff-7740-45b1-b2e1-0df62797fc3a","Type":"ContainerStarted","Data":"24bffd4d031a02caa69a93b74d8168328062c9554ad9d7d7729e6d431302468e"}
Jul 13 18:39:53.402185 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:53.402161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6k8vw" event={"ID":"3c0f7e67-f2b0-41a0-af6e-4814f288038e","Type":"ContainerStarted","Data":"09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9"}
Jul 13 18:39:53.402317 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:53.402238    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6k8vw" podUID="3c0f7e67-f2b0-41a0-af6e-4814f288038e" containerName="registry-server" containerID="cri-o://09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9" gracePeriod=2
Jul 13 18:39:53.418725 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:53.418685    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sc74n" podStartSLOduration=0.750692399 podStartE2EDuration="2.418668852s" totalImagesPullingTime="1.667976453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:39:53.417102893 +0000 UTC m=+480.504208358" watchObservedRunningTime="2026-07-13 18:39:53.418668852 +0000 UTC m=+480.505774584"
Jul 13 18:39:53.432012 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:53.431963    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6k8vw" podStartSLOduration=1.16229261 podStartE2EDuration="3.431945123s" totalImagesPullingTime="2.269652513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:39:53.431314471 +0000 UTC m=+480.518419959" watchObservedRunningTime="2026-07-13 18:39:53.431945123 +0000 UTC m=+480.519050590"
Jul 13 18:39:53.644183 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:53.644154    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6k8vw_3c0f7e67-f2b0-41a0-af6e-4814f288038e/registry-server/0.log"
Jul 13 18:39:53.646394 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:53.646379    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6k8vw"
Jul 13 18:39:53.731417 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:53.731386    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xzxp\" (UniqueName: \"kubernetes.io/projected/3c0f7e67-f2b0-41a0-af6e-4814f288038e-kube-api-access-6xzxp\") pod \"3c0f7e67-f2b0-41a0-af6e-4814f288038e\" (UID: \"3c0f7e67-f2b0-41a0-af6e-4814f288038e\") "
Jul 13 18:39:53.733647 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:53.733619    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c0f7e67-f2b0-41a0-af6e-4814f288038e-kube-api-access-6xzxp" (OuterVolumeSpecName: "kube-api-access-6xzxp") pod "3c0f7e67-f2b0-41a0-af6e-4814f288038e" (UID: "3c0f7e67-f2b0-41a0-af6e-4814f288038e"). InnerVolumeSpecName "kube-api-access-6xzxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:39:53.832867 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:53.832785    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xzxp\" (UniqueName: \"kubernetes.io/projected/3c0f7e67-f2b0-41a0-af6e-4814f288038e-kube-api-access-6xzxp\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:39:54.407378 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:54.407351    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6k8vw_3c0f7e67-f2b0-41a0-af6e-4814f288038e/registry-server/0.log"
Jul 13 18:39:54.407802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:54.407388    2565 generic.go:356] "Generic (PLEG): container finished" podID="3c0f7e67-f2b0-41a0-af6e-4814f288038e" containerID="09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9" exitCode=1
Jul 13 18:39:54.407802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:54.407425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6k8vw" event={"ID":"3c0f7e67-f2b0-41a0-af6e-4814f288038e","Type":"ContainerDied","Data":"09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9"}
Jul 13 18:39:54.407802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:54.407500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6k8vw" event={"ID":"3c0f7e67-f2b0-41a0-af6e-4814f288038e","Type":"ContainerDied","Data":"bfc942ec618d588829c65a4399633cfcf4506a1116f57306c3f335f896e100a2"}
Jul 13 18:39:54.407802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:54.407435    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6k8vw"
Jul 13 18:39:54.407802 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:54.407524    2565 scope.go:117] "RemoveContainer" containerID="09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9"
Jul 13 18:39:54.419221 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:54.419194    2565 scope.go:117] "RemoveContainer" containerID="09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9"
Jul 13 18:39:54.419513 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:39:54.419492    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9\": container with ID starting with 09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9 not found: ID does not exist" containerID="09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9"
Jul 13 18:39:54.419573 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:54.419521    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9"} err="failed to get container status \"09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9\": rpc error: code = NotFound desc = could not find container \"09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9\": container with ID starting with 09866145048d53f3487c55c969a5f2da8b02157f3c69556f7e6ac6ccdbc08ca9 not found: ID does not exist"
Jul 13 18:39:54.435285 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:54.435264    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6k8vw"]
Jul 13 18:39:54.439328 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:54.439306    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6k8vw"]
Jul 13 18:39:55.465077 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:39:55.465045    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c0f7e67-f2b0-41a0-af6e-4814f288038e" path="/var/lib/kubelet/pods/3c0f7e67-f2b0-41a0-af6e-4814f288038e/volumes"
Jul 13 18:40:01.410295 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:01.410254    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sc74n"
Jul 13 18:40:01.410793 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:01.410350    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sc74n"
Jul 13 18:40:01.432563 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:01.432539    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sc74n"
Jul 13 18:40:01.464271 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:01.464249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sc74n"
Jul 13 18:40:18.785790 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:18.785756    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"]
Jul 13 18:40:18.786254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:18.786173    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0f7e67-f2b0-41a0-af6e-4814f288038e" containerName="registry-server"
Jul 13 18:40:18.786254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:18.786193    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0f7e67-f2b0-41a0-af6e-4814f288038e" containerName="registry-server"
Jul 13 18:40:18.786384 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:18.786278    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c0f7e67-f2b0-41a0-af6e-4814f288038e" containerName="registry-server"
Jul 13 18:40:18.788766 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:18.788744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:18.791737 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:18.791720    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xqk27\""
Jul 13 18:40:18.806167 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:18.806138    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"]
Jul 13 18:40:18.947716 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:18.947683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4dvn\" (UniqueName: \"kubernetes.io/projected/2de9617e-f0ca-4430-8a93-ebe68697c34b-kube-api-access-p4dvn\") pod \"limitador-operator-controller-manager-859d7b78bd-f2tjn\" (UID: \"2de9617e-f0ca-4430-8a93-ebe68697c34b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:19.049060 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:19.048953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4dvn\" (UniqueName: \"kubernetes.io/projected/2de9617e-f0ca-4430-8a93-ebe68697c34b-kube-api-access-p4dvn\") pod \"limitador-operator-controller-manager-859d7b78bd-f2tjn\" (UID: \"2de9617e-f0ca-4430-8a93-ebe68697c34b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:19.078787 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:19.078761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4dvn\" (UniqueName: \"kubernetes.io/projected/2de9617e-f0ca-4430-8a93-ebe68697c34b-kube-api-access-p4dvn\") pod \"limitador-operator-controller-manager-859d7b78bd-f2tjn\" (UID: \"2de9617e-f0ca-4430-8a93-ebe68697c34b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:19.099091 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:19.099064    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:19.231137 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:19.231100    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"]
Jul 13 18:40:19.234274 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:40:19.234245    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de9617e_f0ca_4430_8a93_ebe68697c34b.slice/crio-066cad7a7ef3924d0a40ffbf5f98688473d9c270162696c580d5b2390db54914 WatchSource:0}: Error finding container 066cad7a7ef3924d0a40ffbf5f98688473d9c270162696c580d5b2390db54914: Status 404 returned error can't find the container with id 066cad7a7ef3924d0a40ffbf5f98688473d9c270162696c580d5b2390db54914
Jul 13 18:40:19.507095 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:19.507059    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn" event={"ID":"2de9617e-f0ca-4430-8a93-ebe68697c34b","Type":"ContainerStarted","Data":"066cad7a7ef3924d0a40ffbf5f98688473d9c270162696c580d5b2390db54914"}
Jul 13 18:40:22.522022 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:22.521988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn" event={"ID":"2de9617e-f0ca-4430-8a93-ebe68697c34b","Type":"ContainerStarted","Data":"6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414"}
Jul 13 18:40:22.522430 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:22.522116    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:22.544159 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:22.544104    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn" podStartSLOduration=1.914926431 podStartE2EDuration="4.544085617s" totalImagesPullingTime="2.629159186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:40:22.543594482 +0000 UTC m=+509.630699978" watchObservedRunningTime="2026-07-13 18:40:22.544085617 +0000 UTC m=+509.631191082"
Jul 13 18:40:28.253557 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.253521    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"]
Jul 13 18:40:28.258420 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.258397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:28.261722 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.261693    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hv92m\""
Jul 13 18:40:28.273109 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.273087    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"]
Jul 13 18:40:28.311329 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.311292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h288\" (UniqueName: \"kubernetes.io/projected/62d228ec-d476-4869-a36c-84fee59bb443-kube-api-access-5h288\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" (UID: \"62d228ec-d476-4869-a36c-84fee59bb443\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:28.311464 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.311347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d228ec-d476-4869-a36c-84fee59bb443-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" (UID: \"62d228ec-d476-4869-a36c-84fee59bb443\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:28.412327 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.412293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h288\" (UniqueName: \"kubernetes.io/projected/62d228ec-d476-4869-a36c-84fee59bb443-kube-api-access-5h288\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" (UID: \"62d228ec-d476-4869-a36c-84fee59bb443\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:28.412446 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.412353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d228ec-d476-4869-a36c-84fee59bb443-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" (UID: \"62d228ec-d476-4869-a36c-84fee59bb443\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:28.412740 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.412723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d228ec-d476-4869-a36c-84fee59bb443-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" (UID: \"62d228ec-d476-4869-a36c-84fee59bb443\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:28.424941 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.424912    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h288\" (UniqueName: \"kubernetes.io/projected/62d228ec-d476-4869-a36c-84fee59bb443-kube-api-access-5h288\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" (UID: \"62d228ec-d476-4869-a36c-84fee59bb443\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:28.568660 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.568577    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:28.725948 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:28.725836    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"]
Jul 13 18:40:28.728955 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:40:28.728928    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d228ec_d476_4869_a36c_84fee59bb443.slice/crio-92f80c107ad7eb93d8dda40e4fa39672b9d5552bea325e8cbb1e6e4ce1939f47 WatchSource:0}: Error finding container 92f80c107ad7eb93d8dda40e4fa39672b9d5552bea325e8cbb1e6e4ce1939f47: Status 404 returned error can't find the container with id 92f80c107ad7eb93d8dda40e4fa39672b9d5552bea325e8cbb1e6e4ce1939f47
Jul 13 18:40:29.550606 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:29.550566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c" event={"ID":"62d228ec-d476-4869-a36c-84fee59bb443","Type":"ContainerStarted","Data":"92f80c107ad7eb93d8dda40e4fa39672b9d5552bea325e8cbb1e6e4ce1939f47"}
Jul 13 18:40:33.528355 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:33.528325    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:35.578698 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:35.578577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c" event={"ID":"62d228ec-d476-4869-a36c-84fee59bb443","Type":"ContainerStarted","Data":"90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee"}
Jul 13 18:40:35.578698 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:35.578675    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:35.602321 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:35.602274    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c" podStartSLOduration=1.121462089 podStartE2EDuration="7.60226085s" totalImagesPullingTime="6.480798761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:40:35.599643196 +0000 UTC m=+522.686748668" watchObservedRunningTime="2026-07-13 18:40:35.60226085 +0000 UTC m=+522.689366314"
Jul 13 18:40:46.585834 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:46.585764    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:48.551374 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.551339    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"]
Jul 13 18:40:48.551811 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.551556    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c" podUID="62d228ec-d476-4869-a36c-84fee59bb443" containerName="manager" containerID="cri-o://90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee" gracePeriod=2
Jul 13 18:40:48.564405 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.564373    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"]
Jul 13 18:40:48.565413 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:48.565373    2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"62d228ec-d476-4869-a36c-84fee59bb443\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\": pods \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:48.582576 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.582546    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"]
Jul 13 18:40:48.582830 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.582788    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn" podUID="2de9617e-f0ca-4430-8a93-ebe68697c34b" containerName="manager" containerID="cri-o://6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414" gracePeriod=2
Jul 13 18:40:48.594140 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.594114    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"]
Jul 13 18:40:48.594523 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.594506    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d228ec-d476-4869-a36c-84fee59bb443" containerName="manager"
Jul 13 18:40:48.594523 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.594525    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d228ec-d476-4869-a36c-84fee59bb443" containerName="manager"
Jul 13 18:40:48.594688 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.594623    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62d228ec-d476-4869-a36c-84fee59bb443" containerName="manager"
Jul 13 18:40:48.596032 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:48.596003    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" is forbidden: User \"system:node:ip-10-0-131-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-162.ec2.internal' and this object" podUID="62d228ec-d476-4869-a36c-84fee59bb443" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:48.598915 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.598892    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"]
Jul 13 18:40:48.599022 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.598978    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:40:48.601507 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:48.601459    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" is forbidden: User \"system:node:ip-10-0-131-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-162.ec2.internal' and this object" podUID="62d228ec-d476-4869-a36c-84fee59bb443" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:48.613183 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.613161    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7"]
Jul 13 18:40:48.613423 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.613410    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de9617e-f0ca-4430-8a93-ebe68697c34b" containerName="manager"
Jul 13 18:40:48.613423 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.613423    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de9617e-f0ca-4430-8a93-ebe68697c34b" containerName="manager"
Jul 13 18:40:48.613546 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.613496    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de9617e-f0ca-4430-8a93-ebe68697c34b" containerName="manager"
Jul 13 18:40:48.616131 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.616112    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7"
Jul 13 18:40:48.619604 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.619551    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"]
Jul 13 18:40:48.639530 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.639124    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7"]
Jul 13 18:40:48.657299 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:48.657262    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2tjn\" is forbidden: User \"system:node:ip-10-0-131-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-162.ec2.internal' and this object" podUID="2de9617e-f0ca-4430-8a93-ebe68697c34b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:48.663836 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:48.663795    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2tjn\" is forbidden: User \"system:node:ip-10-0-131-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-162.ec2.internal' and this object" podUID="2de9617e-f0ca-4430-8a93-ebe68697c34b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:48.665947 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:48.665917    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" is forbidden: User \"system:node:ip-10-0-131-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-162.ec2.internal' and this object" podUID="62d228ec-d476-4869-a36c-84fee59bb443" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:48.687026 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.686993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrpfg\" (UniqueName: \"kubernetes.io/projected/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-kube-api-access-lrpfg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5bbnx\" (UID: \"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:40:48.687146 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.687068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5bbnx\" (UID: \"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:40:48.687146 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.687130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqw2t\" (UniqueName: \"kubernetes.io/projected/c67d1dd9-4750-4ce0-a7eb-f6ba384d8007-kube-api-access-zqw2t\") pod \"limitador-operator-controller-manager-859d7b78bd-jfrb7\" (UID: \"c67d1dd9-4750-4ce0-a7eb-f6ba384d8007\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7"
Jul 13 18:40:48.788057 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.788022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrpfg\" (UniqueName: \"kubernetes.io/projected/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-kube-api-access-lrpfg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5bbnx\" (UID: \"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:40:48.788225 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.788069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5bbnx\" (UID: \"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:40:48.788225 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.788107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqw2t\" (UniqueName: \"kubernetes.io/projected/c67d1dd9-4750-4ce0-a7eb-f6ba384d8007-kube-api-access-zqw2t\") pod \"limitador-operator-controller-manager-859d7b78bd-jfrb7\" (UID: \"c67d1dd9-4750-4ce0-a7eb-f6ba384d8007\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7"
Jul 13 18:40:48.788592 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.788559    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5bbnx\" (UID: \"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:40:48.800108 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.800077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqw2t\" (UniqueName: \"kubernetes.io/projected/c67d1dd9-4750-4ce0-a7eb-f6ba384d8007-kube-api-access-zqw2t\") pod \"limitador-operator-controller-manager-859d7b78bd-jfrb7\" (UID: \"c67d1dd9-4750-4ce0-a7eb-f6ba384d8007\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7"
Jul 13 18:40:48.800815 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.800791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrpfg\" (UniqueName: \"kubernetes.io/projected/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-kube-api-access-lrpfg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5bbnx\" (UID: \"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:40:48.821671 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.821645    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:48.824133 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:48.824103    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2tjn\" is forbidden: User \"system:node:ip-10-0-131-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-162.ec2.internal' and this object" podUID="2de9617e-f0ca-4430-8a93-ebe68697c34b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:48.824286 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.824271    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:48.826460 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:48.826434    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" is forbidden: User \"system:node:ip-10-0-131-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-162.ec2.internal' and this object" podUID="62d228ec-d476-4869-a36c-84fee59bb443" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:48.828715 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:48.828691    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdj4c\" is forbidden: User \"system:node:ip-10-0-131-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-162.ec2.internal' and this object" podUID="62d228ec-d476-4869-a36c-84fee59bb443" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:48.830833 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:48.830813    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2tjn\" is forbidden: User \"system:node:ip-10-0-131-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-162.ec2.internal' and this object" podUID="2de9617e-f0ca-4430-8a93-ebe68697c34b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:48.888910 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.888873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4dvn\" (UniqueName: \"kubernetes.io/projected/2de9617e-f0ca-4430-8a93-ebe68697c34b-kube-api-access-p4dvn\") pod \"2de9617e-f0ca-4430-8a93-ebe68697c34b\" (UID: \"2de9617e-f0ca-4430-8a93-ebe68697c34b\") "
Jul 13 18:40:48.889080 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.888941    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d228ec-d476-4869-a36c-84fee59bb443-extensions-socket-volume\") pod \"62d228ec-d476-4869-a36c-84fee59bb443\" (UID: \"62d228ec-d476-4869-a36c-84fee59bb443\") "
Jul 13 18:40:48.889080 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.888971    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h288\" (UniqueName: \"kubernetes.io/projected/62d228ec-d476-4869-a36c-84fee59bb443-kube-api-access-5h288\") pod \"62d228ec-d476-4869-a36c-84fee59bb443\" (UID: \"62d228ec-d476-4869-a36c-84fee59bb443\") "
Jul 13 18:40:48.889456 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.889422    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d228ec-d476-4869-a36c-84fee59bb443-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "62d228ec-d476-4869-a36c-84fee59bb443" (UID: "62d228ec-d476-4869-a36c-84fee59bb443"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:40:48.891166 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.891142    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d228ec-d476-4869-a36c-84fee59bb443-kube-api-access-5h288" (OuterVolumeSpecName: "kube-api-access-5h288") pod "62d228ec-d476-4869-a36c-84fee59bb443" (UID: "62d228ec-d476-4869-a36c-84fee59bb443"). InnerVolumeSpecName "kube-api-access-5h288". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:40:48.891265 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.891204    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de9617e-f0ca-4430-8a93-ebe68697c34b-kube-api-access-p4dvn" (OuterVolumeSpecName: "kube-api-access-p4dvn") pod "2de9617e-f0ca-4430-8a93-ebe68697c34b" (UID: "2de9617e-f0ca-4430-8a93-ebe68697c34b"). InnerVolumeSpecName "kube-api-access-p4dvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:40:48.982510 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.982450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:40:48.988689 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.988664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7"
Jul 13 18:40:48.989957 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.989940    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4dvn\" (UniqueName: \"kubernetes.io/projected/2de9617e-f0ca-4430-8a93-ebe68697c34b-kube-api-access-p4dvn\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:40:48.990006 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.989960    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d228ec-d476-4869-a36c-84fee59bb443-extensions-socket-volume\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:40:48.990006 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:48.989971    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h288\" (UniqueName: \"kubernetes.io/projected/62d228ec-d476-4869-a36c-84fee59bb443-kube-api-access-5h288\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:40:49.125231 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.125205    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"]
Jul 13 18:40:49.127686 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:40:49.127652    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode459dbd0_c5b2_4e68_ab85_f3b6cb608f8b.slice/crio-00e96ea1776a423a0d4666c7926ab93ed8361e4cf82371bcb47d1e2c0ae3e093 WatchSource:0}: Error finding container 00e96ea1776a423a0d4666c7926ab93ed8361e4cf82371bcb47d1e2c0ae3e093: Status 404 returned error can't find the container with id 00e96ea1776a423a0d4666c7926ab93ed8361e4cf82371bcb47d1e2c0ae3e093
Jul 13 18:40:49.145873 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.145848    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7"]
Jul 13 18:40:49.148412 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:40:49.148383    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc67d1dd9_4750_4ce0_a7eb_f6ba384d8007.slice/crio-433fafc57b82f0296fc7790f4bf71e93fc617ee6c93f1c0d62643a66b1d3f439 WatchSource:0}: Error finding container 433fafc57b82f0296fc7790f4bf71e93fc617ee6c93f1c0d62643a66b1d3f439: Status 404 returned error can't find the container with id 433fafc57b82f0296fc7790f4bf71e93fc617ee6c93f1c0d62643a66b1d3f439
Jul 13 18:40:49.466729 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.466698    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2de9617e-f0ca-4430-8a93-ebe68697c34b" path="/var/lib/kubelet/pods/2de9617e-f0ca-4430-8a93-ebe68697c34b/volumes"
Jul 13 18:40:49.467144 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.467124    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62d228ec-d476-4869-a36c-84fee59bb443" path="/var/lib/kubelet/pods/62d228ec-d476-4869-a36c-84fee59bb443/volumes"
Jul 13 18:40:49.641210 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.641178    2565 generic.go:356] "Generic (PLEG): container finished" podID="2de9617e-f0ca-4430-8a93-ebe68697c34b" containerID="6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414" exitCode=0
Jul 13 18:40:49.641680 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.641222    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2tjn"
Jul 13 18:40:49.641680 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.641259    2565 scope.go:117] "RemoveContainer" containerID="6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414"
Jul 13 18:40:49.642677 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.642657    2565 generic.go:356] "Generic (PLEG): container finished" podID="62d228ec-d476-4869-a36c-84fee59bb443" containerID="90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee" exitCode=0
Jul 13 18:40:49.642741 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.642702    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdj4c"
Jul 13 18:40:49.644544 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.644515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7" event={"ID":"c67d1dd9-4750-4ce0-a7eb-f6ba384d8007","Type":"ContainerStarted","Data":"728fd04398b37a86c84b32061d33768fc30a1cb226c411eafe4a63bc13ff8203"}
Jul 13 18:40:49.644795 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.644636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7" event={"ID":"c67d1dd9-4750-4ce0-a7eb-f6ba384d8007","Type":"ContainerStarted","Data":"433fafc57b82f0296fc7790f4bf71e93fc617ee6c93f1c0d62643a66b1d3f439"}
Jul 13 18:40:49.644795 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.644693    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7"
Jul 13 18:40:49.646220 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.646199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx" event={"ID":"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b","Type":"ContainerStarted","Data":"f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d"}
Jul 13 18:40:49.646308 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.646239    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx" event={"ID":"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b","Type":"ContainerStarted","Data":"00e96ea1776a423a0d4666c7926ab93ed8361e4cf82371bcb47d1e2c0ae3e093"}
Jul 13 18:40:49.646360 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.646313    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:40:49.649924 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.649909    2565 scope.go:117] "RemoveContainer" containerID="6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414"
Jul 13 18:40:49.650176 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:49.650156    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414\": container with ID starting with 6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414 not found: ID does not exist" containerID="6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414"
Jul 13 18:40:49.650254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.650191    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414"} err="failed to get container status \"6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414\": rpc error: code = NotFound desc = could not find container \"6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414\": container with ID starting with 6b6cd7cb708d37b2a89876740e7101f63309e015e8da30190bf7d54ea1b68414 not found: ID does not exist"
Jul 13 18:40:49.650254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.650212    2565 scope.go:117] "RemoveContainer" containerID="90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee"
Jul 13 18:40:49.657734 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.657719    2565 scope.go:117] "RemoveContainer" containerID="90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee"
Jul 13 18:40:49.657980 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:40:49.657964    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee\": container with ID starting with 90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee not found: ID does not exist" containerID="90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee"
Jul 13 18:40:49.658035 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.657985    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee"} err="failed to get container status \"90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee\": rpc error: code = NotFound desc = could not find container \"90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee\": container with ID starting with 90cf99dbd9fd986adaa522898246edfa2790a385c71744df8359dce7150a7cee not found: ID does not exist"
Jul 13 18:40:49.665592 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.665556    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7" podStartSLOduration=1.6655437389999999 podStartE2EDuration="1.665543739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:40:49.664115104 +0000 UTC m=+536.751220590" watchObservedRunningTime="2026-07-13 18:40:49.665543739 +0000 UTC m=+536.752649204"
Jul 13 18:40:49.685830 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:40:49.685790    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx" podStartSLOduration=1.685775719 podStartE2EDuration="1.685775719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:40:49.684176547 +0000 UTC m=+536.771282031" watchObservedRunningTime="2026-07-13 18:40:49.685775719 +0000 UTC m=+536.772881184"
Jul 13 18:41:00.656693 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:00.656658    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:41:00.657109 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:00.656737    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jfrb7"
Jul 13 18:41:21.888868 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:21.888830    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"]
Jul 13 18:41:21.889360 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:21.889016    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx" podUID="e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b" containerName="manager" containerID="cri-o://f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d" gracePeriod=10
Jul 13 18:41:22.136217 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.136189    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:41:22.136326 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.136193    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"]
Jul 13 18:41:22.136598 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.136585    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b" containerName="manager"
Jul 13 18:41:22.136643 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.136600    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b" containerName="manager"
Jul 13 18:41:22.136684 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.136675    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b" containerName="manager"
Jul 13 18:41:22.138339 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.138324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:41:22.152629 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.152607    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"]
Jul 13 18:41:22.161548 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.161526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp59t\" (UniqueName: \"kubernetes.io/projected/32afa50e-9762-4358-b34b-3740cc3957a0-kube-api-access-cp59t\") pod \"kuadrant-operator-controller-manager-86878c769f-rgxjr\" (UID: \"32afa50e-9762-4358-b34b-3740cc3957a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:41:22.161674 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.161557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32afa50e-9762-4358-b34b-3740cc3957a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rgxjr\" (UID: \"32afa50e-9762-4358-b34b-3740cc3957a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:41:22.262241 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.262200    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-extensions-socket-volume\") pod \"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b\" (UID: \"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b\") "
Jul 13 18:41:22.262413 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.262287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrpfg\" (UniqueName: \"kubernetes.io/projected/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-kube-api-access-lrpfg\") pod \"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b\" (UID: \"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b\") "
Jul 13 18:41:22.262459 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.262410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp59t\" (UniqueName: \"kubernetes.io/projected/32afa50e-9762-4358-b34b-3740cc3957a0-kube-api-access-cp59t\") pod \"kuadrant-operator-controller-manager-86878c769f-rgxjr\" (UID: \"32afa50e-9762-4358-b34b-3740cc3957a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:41:22.262549 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.262454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32afa50e-9762-4358-b34b-3740cc3957a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rgxjr\" (UID: \"32afa50e-9762-4358-b34b-3740cc3957a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:41:22.262672 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.262652    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b" (UID: "e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:41:22.262895 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.262873    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32afa50e-9762-4358-b34b-3740cc3957a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rgxjr\" (UID: \"32afa50e-9762-4358-b34b-3740cc3957a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:41:22.264512 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.264483    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-kube-api-access-lrpfg" (OuterVolumeSpecName: "kube-api-access-lrpfg") pod "e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b" (UID: "e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b"). InnerVolumeSpecName "kube-api-access-lrpfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:41:22.282211 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.282189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp59t\" (UniqueName: \"kubernetes.io/projected/32afa50e-9762-4358-b34b-3740cc3957a0-kube-api-access-cp59t\") pod \"kuadrant-operator-controller-manager-86878c769f-rgxjr\" (UID: \"32afa50e-9762-4358-b34b-3740cc3957a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:41:22.362916 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.362878    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrpfg\" (UniqueName: \"kubernetes.io/projected/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-kube-api-access-lrpfg\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:41:22.362916 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.362907    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b-extensions-socket-volume\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:41:22.447429 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.447338    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:41:22.580117 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.580091    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"]
Jul 13 18:41:22.582616 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:41:22.582588    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32afa50e_9762_4358_b34b_3740cc3957a0.slice/crio-4a9ea15b8a14940c8107cf322c9ec131b7371ddeeebd10469e6bb8582eab0138 WatchSource:0}: Error finding container 4a9ea15b8a14940c8107cf322c9ec131b7371ddeeebd10469e6bb8582eab0138: Status 404 returned error can't find the container with id 4a9ea15b8a14940c8107cf322c9ec131b7371ddeeebd10469e6bb8582eab0138
Jul 13 18:41:22.789115 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.788993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr" event={"ID":"32afa50e-9762-4358-b34b-3740cc3957a0","Type":"ContainerStarted","Data":"20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911"}
Jul 13 18:41:22.789115 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.789071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr" event={"ID":"32afa50e-9762-4358-b34b-3740cc3957a0","Type":"ContainerStarted","Data":"4a9ea15b8a14940c8107cf322c9ec131b7371ddeeebd10469e6bb8582eab0138"}
Jul 13 18:41:22.789115 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.789102    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:41:22.790356 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.790326    2565 generic.go:356] "Generic (PLEG): container finished" podID="e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b" containerID="f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d" exitCode=0
Jul 13 18:41:22.790502 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.790369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx" event={"ID":"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b","Type":"ContainerDied","Data":"f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d"}
Jul 13 18:41:22.790502 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.790378    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"
Jul 13 18:41:22.790502 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.790412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx" event={"ID":"e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b","Type":"ContainerDied","Data":"00e96ea1776a423a0d4666c7926ab93ed8361e4cf82371bcb47d1e2c0ae3e093"}
Jul 13 18:41:22.790502 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.790436    2565 scope.go:117] "RemoveContainer" containerID="f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d"
Jul 13 18:41:22.812703 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.799782    2565 scope.go:117] "RemoveContainer" containerID="f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d"
Jul 13 18:41:22.812703 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:41:22.800191    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d\": container with ID starting with f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d not found: ID does not exist" containerID="f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d"
Jul 13 18:41:22.812703 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.800226    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d"} err="failed to get container status \"f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d\": rpc error: code = NotFound desc = could not find container \"f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d\": container with ID starting with f38a0e91675c2b84462a07c2036cb9c20d2b2815b0ad5a95376513e10596964d not found: ID does not exist"
Jul 13 18:41:22.836190 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.836137    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr" podStartSLOduration=0.836119361 podStartE2EDuration="836.119361ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:41:22.821353522 +0000 UTC m=+569.908459000" watchObservedRunningTime="2026-07-13 18:41:22.836119361 +0000 UTC m=+569.923224843"
Jul 13 18:41:22.836355 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.836263    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"]
Jul 13 18:41:22.840297 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:22.840273    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5bbnx"]
Jul 13 18:41:23.465613 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:23.465584    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b" path="/var/lib/kubelet/pods/e459dbd0-c5b2-4e68-ab85-f3b6cb608f8b/volumes"
Jul 13 18:41:33.797824 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:33.797792    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:41:38.321731 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.321696    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"]
Jul 13 18:41:38.324203 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.324179    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.326934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.326914    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-f2bqg\""
Jul 13 18:41:38.337340 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.337315    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"]
Jul 13 18:41:38.386836 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.386806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.386956 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.386864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.386956 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.386882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.386956 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.386903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.386956 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.386919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.386956 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.386945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.387185 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.386999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.387185 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.387020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhhkj\" (UniqueName: \"kubernetes.io/projected/0aaabb14-a750-4734-bb78-2f49e6ac7e03-kube-api-access-lhhkj\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.387185 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.387050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.487956 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.487903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.487956 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.487957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488218 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.487997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488218 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488218 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhhkj\" (UniqueName: \"kubernetes.io/projected/0aaabb14-a750-4734-bb78-2f49e6ac7e03-kube-api-access-lhhkj\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488218 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488218 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488218 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488218 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488593 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488593 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488593 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488744 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.488961 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.488932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.490690 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.490664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.490885 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.490866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.496847 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.496823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0aaabb14-a750-4734-bb78-2f49e6ac7e03-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.497126 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.497105    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhhkj\" (UniqueName: \"kubernetes.io/projected/0aaabb14-a750-4734-bb78-2f49e6ac7e03-kube-api-access-lhhkj\") pod \"maas-default-gateway-openshift-default-56654dcf7-tn7vt\" (UID: \"0aaabb14-a750-4734-bb78-2f49e6ac7e03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.634919 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.634823    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:38.773971 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.773942    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"]
Jul 13 18:41:38.776058 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:41:38.776026    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aaabb14_a750_4734_bb78_2f49e6ac7e03.slice/crio-f6789045f80a0bd5db9fe96347acd8d0d6198c2b1eb0dd9390373f0b657506c4 WatchSource:0}: Error finding container f6789045f80a0bd5db9fe96347acd8d0d6198c2b1eb0dd9390373f0b657506c4: Status 404 returned error can't find the container with id f6789045f80a0bd5db9fe96347acd8d0d6198c2b1eb0dd9390373f0b657506c4
Jul 13 18:41:38.778180 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.778142    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:41:38.778257 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.778210    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:41:38.778257 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.778245    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:41:38.865876 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.865837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt" event={"ID":"0aaabb14-a750-4734-bb78-2f49e6ac7e03","Type":"ContainerStarted","Data":"51d529f204dd7832011b4c7e2e2958a13f54331d167c3fd3ffde122479bce809"}
Jul 13 18:41:38.866052 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.865904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt" event={"ID":"0aaabb14-a750-4734-bb78-2f49e6ac7e03","Type":"ContainerStarted","Data":"f6789045f80a0bd5db9fe96347acd8d0d6198c2b1eb0dd9390373f0b657506c4"}
Jul 13 18:41:38.890848 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:38.890805    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt" podStartSLOduration=0.89078993 podStartE2EDuration="890.78993ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:41:38.889553752 +0000 UTC m=+585.976659244" watchObservedRunningTime="2026-07-13 18:41:38.89078993 +0000 UTC m=+585.977895394"
Jul 13 18:41:39.635876 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:39.635836    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:39.640893 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:39.640870    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:39.870820 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:39.870789    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:39.871901 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:39.871881    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:41:42.930419 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:42.930381    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-cw4nf"]
Jul 13 18:41:42.933008 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:42.932987    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cw4nf"
Jul 13 18:41:42.935455 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:42.935437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wb6lw\""
Jul 13 18:41:42.941269 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:42.941245    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cw4nf"]
Jul 13 18:41:43.027434 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:43.027396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd92k\" (UniqueName: \"kubernetes.io/projected/8945d66e-3cb8-425f-a165-c1037724760b-kube-api-access-rd92k\") pod \"authorino-58cd955675-cw4nf\" (UID: \"8945d66e-3cb8-425f-a165-c1037724760b\") " pod="kuadrant-system/authorino-58cd955675-cw4nf"
Jul 13 18:41:43.128048 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:43.128013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd92k\" (UniqueName: \"kubernetes.io/projected/8945d66e-3cb8-425f-a165-c1037724760b-kube-api-access-rd92k\") pod \"authorino-58cd955675-cw4nf\" (UID: \"8945d66e-3cb8-425f-a165-c1037724760b\") " pod="kuadrant-system/authorino-58cd955675-cw4nf"
Jul 13 18:41:43.137107 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:43.137081    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd92k\" (UniqueName: \"kubernetes.io/projected/8945d66e-3cb8-425f-a165-c1037724760b-kube-api-access-rd92k\") pod \"authorino-58cd955675-cw4nf\" (UID: \"8945d66e-3cb8-425f-a165-c1037724760b\") " pod="kuadrant-system/authorino-58cd955675-cw4nf"
Jul 13 18:41:43.243329 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:43.243249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cw4nf"
Jul 13 18:41:43.370945 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:43.370910    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cw4nf"]
Jul 13 18:41:43.374236 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:41:43.374206    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8945d66e_3cb8_425f_a165_c1037724760b.slice/crio-fef455f259593a35c3096b8ba43c5bcd74dc309081130c4989e5799bb2e3b46e WatchSource:0}: Error finding container fef455f259593a35c3096b8ba43c5bcd74dc309081130c4989e5799bb2e3b46e: Status 404 returned error can't find the container with id fef455f259593a35c3096b8ba43c5bcd74dc309081130c4989e5799bb2e3b46e
Jul 13 18:41:43.887977 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:43.887940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cw4nf" event={"ID":"8945d66e-3cb8-425f-a165-c1037724760b","Type":"ContainerStarted","Data":"fef455f259593a35c3096b8ba43c5bcd74dc309081130c4989e5799bb2e3b46e"}
Jul 13 18:41:47.908783 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:47.908727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cw4nf" event={"ID":"8945d66e-3cb8-425f-a165-c1037724760b","Type":"ContainerStarted","Data":"bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a"}
Jul 13 18:41:47.925411 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:47.925361    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-cw4nf" podStartSLOduration=2.445441594 podStartE2EDuration="5.925345832s" totalImagesPullingTime="3.479904238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:41:47.923573797 +0000 UTC m=+595.010679262" watchObservedRunningTime="2026-07-13 18:41:47.925345832 +0000 UTC m=+595.012451297"
Jul 13 18:41:49.086542 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:49.086504    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cw4nf"]
Jul 13 18:41:49.917134 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:49.917095    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-cw4nf" podUID="8945d66e-3cb8-425f-a165-c1037724760b" containerName="authorino" containerID="cri-o://bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a" gracePeriod=30
Jul 13 18:41:50.153673 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.153650    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cw4nf"
Jul 13 18:41:50.297610 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.297534    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rd92k\" (UniqueName: \"kubernetes.io/projected/8945d66e-3cb8-425f-a165-c1037724760b-kube-api-access-rd92k\") pod \"8945d66e-3cb8-425f-a165-c1037724760b\" (UID: \"8945d66e-3cb8-425f-a165-c1037724760b\") "
Jul 13 18:41:50.299723 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.299695    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8945d66e-3cb8-425f-a165-c1037724760b-kube-api-access-rd92k" (OuterVolumeSpecName: "kube-api-access-rd92k") pod "8945d66e-3cb8-425f-a165-c1037724760b" (UID: "8945d66e-3cb8-425f-a165-c1037724760b"). InnerVolumeSpecName "kube-api-access-rd92k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:41:50.398490 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.398434    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd92k\" (UniqueName: \"kubernetes.io/projected/8945d66e-3cb8-425f-a165-c1037724760b-kube-api-access-rd92k\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:41:50.922254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.922220    2565 generic.go:356] "Generic (PLEG): container finished" podID="8945d66e-3cb8-425f-a165-c1037724760b" containerID="bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a" exitCode=0
Jul 13 18:41:50.922442 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.922260    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cw4nf"
Jul 13 18:41:50.922442 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.922305    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cw4nf" event={"ID":"8945d66e-3cb8-425f-a165-c1037724760b","Type":"ContainerDied","Data":"bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a"}
Jul 13 18:41:50.922442 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.922351    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cw4nf" event={"ID":"8945d66e-3cb8-425f-a165-c1037724760b","Type":"ContainerDied","Data":"fef455f259593a35c3096b8ba43c5bcd74dc309081130c4989e5799bb2e3b46e"}
Jul 13 18:41:50.922442 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.922369    2565 scope.go:117] "RemoveContainer" containerID="bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a"
Jul 13 18:41:50.930929 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.930912    2565 scope.go:117] "RemoveContainer" containerID="bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a"
Jul 13 18:41:50.931192 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:41:50.931175    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a\": container with ID starting with bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a not found: ID does not exist" containerID="bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a"
Jul 13 18:41:50.931226 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.931202    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a"} err="failed to get container status \"bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a\": rpc error: code = NotFound desc = could not find container \"bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a\": container with ID starting with bd8e05c2d906ae5888103f0b786679881bc8bd5a4e277d4e538b56cb47bbc15a not found: ID does not exist"
Jul 13 18:41:50.942894 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.942870    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cw4nf"]
Jul 13 18:41:50.946394 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:50.946375    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-cw4nf"]
Jul 13 18:41:51.465062 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:51.465028    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8945d66e-3cb8-425f-a165-c1037724760b" path="/var/lib/kubelet/pods/8945d66e-3cb8-425f-a165-c1037724760b/volumes"
Jul 13 18:41:53.306159 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:53.306125    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:41:53.308530 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:53.308509    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:41:53.311213 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:53.311195    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:41:53.318669 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:41:53.318649    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:42:25.140880 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.140795    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f4779d9bd-mx4nm"]
Jul 13 18:42:25.141454 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.141159    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8945d66e-3cb8-425f-a165-c1037724760b" containerName="authorino"
Jul 13 18:42:25.141454 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.141172    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8945d66e-3cb8-425f-a165-c1037724760b" containerName="authorino"
Jul 13 18:42:25.141454 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.141243    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8945d66e-3cb8-425f-a165-c1037724760b" containerName="authorino"
Jul 13 18:42:25.143158 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.143135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:25.145771 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.145748    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 18:42:25.146295 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.146275    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 18:42:25.146837 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.146818    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-l5fz5\""
Jul 13 18:42:25.160450 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.160431    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f4779d9bd-mx4nm"]
Jul 13 18:42:25.185065 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.184999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb5fw\" (UniqueName: \"kubernetes.io/projected/5fcb1901-5ad2-4ed3-8332-305c3039a95a-kube-api-access-cb5fw\") pod \"maas-controller-5f4779d9bd-mx4nm\" (UID: \"5fcb1901-5ad2-4ed3-8332-305c3039a95a\") " pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:25.185232 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.185114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fcb1901-5ad2-4ed3-8332-305c3039a95a-webhook-cert\") pod \"maas-controller-5f4779d9bd-mx4nm\" (UID: \"5fcb1901-5ad2-4ed3-8332-305c3039a95a\") " pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:25.286254 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.286222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb5fw\" (UniqueName: \"kubernetes.io/projected/5fcb1901-5ad2-4ed3-8332-305c3039a95a-kube-api-access-cb5fw\") pod \"maas-controller-5f4779d9bd-mx4nm\" (UID: \"5fcb1901-5ad2-4ed3-8332-305c3039a95a\") " pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:25.286446 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.286277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fcb1901-5ad2-4ed3-8332-305c3039a95a-webhook-cert\") pod \"maas-controller-5f4779d9bd-mx4nm\" (UID: \"5fcb1901-5ad2-4ed3-8332-305c3039a95a\") " pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:25.288815 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.288791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fcb1901-5ad2-4ed3-8332-305c3039a95a-webhook-cert\") pod \"maas-controller-5f4779d9bd-mx4nm\" (UID: \"5fcb1901-5ad2-4ed3-8332-305c3039a95a\") " pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:25.295434 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.295412    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb5fw\" (UniqueName: \"kubernetes.io/projected/5fcb1901-5ad2-4ed3-8332-305c3039a95a-kube-api-access-cb5fw\") pod \"maas-controller-5f4779d9bd-mx4nm\" (UID: \"5fcb1901-5ad2-4ed3-8332-305c3039a95a\") " pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:25.358222 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.358195    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d9b58f676-6b9kq"]
Jul 13 18:42:25.360448 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.360432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:42:25.379704 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.379676    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d9b58f676-6b9kq"]
Jul 13 18:42:25.386787 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.386761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67f55337-839d-4e0d-906c-a6462b7a06a5-webhook-cert\") pod \"maas-controller-d9b58f676-6b9kq\" (UID: \"67f55337-839d-4e0d-906c-a6462b7a06a5\") " pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:42:25.386912 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.386804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bl9x\" (UniqueName: \"kubernetes.io/projected/67f55337-839d-4e0d-906c-a6462b7a06a5-kube-api-access-5bl9x\") pod \"maas-controller-d9b58f676-6b9kq\" (UID: \"67f55337-839d-4e0d-906c-a6462b7a06a5\") " pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:42:25.454748 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.454663    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:25.488239 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.488214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67f55337-839d-4e0d-906c-a6462b7a06a5-webhook-cert\") pod \"maas-controller-d9b58f676-6b9kq\" (UID: \"67f55337-839d-4e0d-906c-a6462b7a06a5\") " pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:42:25.488379 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.488256    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bl9x\" (UniqueName: \"kubernetes.io/projected/67f55337-839d-4e0d-906c-a6462b7a06a5-kube-api-access-5bl9x\") pod \"maas-controller-d9b58f676-6b9kq\" (UID: \"67f55337-839d-4e0d-906c-a6462b7a06a5\") " pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:42:25.490730 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.490711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67f55337-839d-4e0d-906c-a6462b7a06a5-webhook-cert\") pod \"maas-controller-d9b58f676-6b9kq\" (UID: \"67f55337-839d-4e0d-906c-a6462b7a06a5\") " pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:42:25.498443 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.498419    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bl9x\" (UniqueName: \"kubernetes.io/projected/67f55337-839d-4e0d-906c-a6462b7a06a5-kube-api-access-5bl9x\") pod \"maas-controller-d9b58f676-6b9kq\" (UID: \"67f55337-839d-4e0d-906c-a6462b7a06a5\") " pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:42:25.592813 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.592785    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f4779d9bd-mx4nm"]
Jul 13 18:42:25.595209 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:42:25.595175    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcb1901_5ad2_4ed3_8332_305c3039a95a.slice/crio-aaeb1a42406e78843972480d996d10a426936dd8f6aaa5d4731f03f8cbeb3fb3 WatchSource:0}: Error finding container aaeb1a42406e78843972480d996d10a426936dd8f6aaa5d4731f03f8cbeb3fb3: Status 404 returned error can't find the container with id aaeb1a42406e78843972480d996d10a426936dd8f6aaa5d4731f03f8cbeb3fb3
Jul 13 18:42:25.670643 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.670614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:42:25.809807 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:25.809779    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d9b58f676-6b9kq"]
Jul 13 18:42:25.811605 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:42:25.811579    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f55337_839d_4e0d_906c_a6462b7a06a5.slice/crio-ce56b3c4ee9a34ecd2738bfa2e8ea8b6088638a44f24e851fa12f403983c4f6f WatchSource:0}: Error finding container ce56b3c4ee9a34ecd2738bfa2e8ea8b6088638a44f24e851fa12f403983c4f6f: Status 404 returned error can't find the container with id ce56b3c4ee9a34ecd2738bfa2e8ea8b6088638a44f24e851fa12f403983c4f6f
Jul 13 18:42:26.080792 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:26.080702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d9b58f676-6b9kq" event={"ID":"67f55337-839d-4e0d-906c-a6462b7a06a5","Type":"ContainerStarted","Data":"ce56b3c4ee9a34ecd2738bfa2e8ea8b6088638a44f24e851fa12f403983c4f6f"}
Jul 13 18:42:26.081693 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:26.081670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm" event={"ID":"5fcb1901-5ad2-4ed3-8332-305c3039a95a","Type":"ContainerStarted","Data":"aaeb1a42406e78843972480d996d10a426936dd8f6aaa5d4731f03f8cbeb3fb3"}
Jul 13 18:42:29.100819 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:29.100728    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d9b58f676-6b9kq" event={"ID":"67f55337-839d-4e0d-906c-a6462b7a06a5","Type":"ContainerStarted","Data":"c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced"}
Jul 13 18:42:29.101217 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:29.100841    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:42:29.102129 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:29.102104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm" event={"ID":"5fcb1901-5ad2-4ed3-8332-305c3039a95a","Type":"ContainerStarted","Data":"bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc"}
Jul 13 18:42:29.102247 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:29.102232    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:29.124181 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:29.124128    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d9b58f676-6b9kq" podStartSLOduration=1.104349254 podStartE2EDuration="4.124115263s" totalImagesPullingTime="3.019766009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:42:29.122803292 +0000 UTC m=+636.209908779" watchObservedRunningTime="2026-07-13 18:42:29.124115263 +0000 UTC m=+636.211220728"
Jul 13 18:42:29.146833 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:29.146784    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm" podStartSLOduration=0.921037452 podStartE2EDuration="4.146768947s" totalImagesPullingTime="3.225731495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:42:29.145279611 +0000 UTC m=+636.232385076" watchObservedRunningTime="2026-07-13 18:42:29.146768947 +0000 UTC m=+636.233874412"
Jul 13 18:42:40.109522 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.109493    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:40.111878 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.109577    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:42:40.179556 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.179511    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f4779d9bd-mx4nm"]
Jul 13 18:42:40.179770 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.179733    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm" podUID="5fcb1901-5ad2-4ed3-8332-305c3039a95a" containerName="manager" containerID="cri-o://bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc" gracePeriod=30
Jul 13 18:42:40.421198 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.421172    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:40.525859 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.525825    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fcb1901-5ad2-4ed3-8332-305c3039a95a-webhook-cert\") pod \"5fcb1901-5ad2-4ed3-8332-305c3039a95a\" (UID: \"5fcb1901-5ad2-4ed3-8332-305c3039a95a\") "
Jul 13 18:42:40.526019 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.525866    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb5fw\" (UniqueName: \"kubernetes.io/projected/5fcb1901-5ad2-4ed3-8332-305c3039a95a-kube-api-access-cb5fw\") pod \"5fcb1901-5ad2-4ed3-8332-305c3039a95a\" (UID: \"5fcb1901-5ad2-4ed3-8332-305c3039a95a\") "
Jul 13 18:42:40.528133 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.528101    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fcb1901-5ad2-4ed3-8332-305c3039a95a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5fcb1901-5ad2-4ed3-8332-305c3039a95a" (UID: "5fcb1901-5ad2-4ed3-8332-305c3039a95a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:42:40.528242 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.528136    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fcb1901-5ad2-4ed3-8332-305c3039a95a-kube-api-access-cb5fw" (OuterVolumeSpecName: "kube-api-access-cb5fw") pod "5fcb1901-5ad2-4ed3-8332-305c3039a95a" (UID: "5fcb1901-5ad2-4ed3-8332-305c3039a95a"). InnerVolumeSpecName "kube-api-access-cb5fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:42:40.627322 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.627286    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fcb1901-5ad2-4ed3-8332-305c3039a95a-webhook-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:42:40.627322 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:40.627317    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb5fw\" (UniqueName: \"kubernetes.io/projected/5fcb1901-5ad2-4ed3-8332-305c3039a95a-kube-api-access-cb5fw\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:42:41.156888 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:41.156853    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fcb1901-5ad2-4ed3-8332-305c3039a95a" containerID="bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc" exitCode=0
Jul 13 18:42:41.157346 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:41.156895    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm"
Jul 13 18:42:41.157346 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:41.156944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm" event={"ID":"5fcb1901-5ad2-4ed3-8332-305c3039a95a","Type":"ContainerDied","Data":"bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc"}
Jul 13 18:42:41.157346 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:41.157005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f4779d9bd-mx4nm" event={"ID":"5fcb1901-5ad2-4ed3-8332-305c3039a95a","Type":"ContainerDied","Data":"aaeb1a42406e78843972480d996d10a426936dd8f6aaa5d4731f03f8cbeb3fb3"}
Jul 13 18:42:41.157346 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:41.157042    2565 scope.go:117] "RemoveContainer" containerID="bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc"
Jul 13 18:42:41.165586 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:41.165569    2565 scope.go:117] "RemoveContainer" containerID="bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc"
Jul 13 18:42:41.165823 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:42:41.165807    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc\": container with ID starting with bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc not found: ID does not exist" containerID="bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc"
Jul 13 18:42:41.165877 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:41.165832    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc"} err="failed to get container status \"bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc\": rpc error: code = NotFound desc = could not find container \"bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc\": container with ID starting with bac5d27f4efd3cc9b4bb18d897a9aeb6b8d06c56ba1f76616d0c6493ab0f77cc not found: ID does not exist"
Jul 13 18:42:41.177975 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:41.177951    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f4779d9bd-mx4nm"]
Jul 13 18:42:41.188438 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:41.188416    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f4779d9bd-mx4nm"]
Jul 13 18:42:41.464843 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:42:41.464771    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fcb1901-5ad2-4ed3-8332-305c3039a95a" path="/var/lib/kubelet/pods/5fcb1901-5ad2-4ed3-8332-305c3039a95a/volumes"
Jul 13 18:43:01.434256 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.434224    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"]
Jul 13 18:43:01.434759 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.434570    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fcb1901-5ad2-4ed3-8332-305c3039a95a" containerName="manager"
Jul 13 18:43:01.434759 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.434582    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fcb1901-5ad2-4ed3-8332-305c3039a95a" containerName="manager"
Jul 13 18:43:01.434759 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.434640    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fcb1901-5ad2-4ed3-8332-305c3039a95a" containerName="manager"
Jul 13 18:43:01.438658 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.438638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"
Jul 13 18:43:01.442384 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.442360    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 13 18:43:01.442878 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.442861    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2bzjx\""
Jul 13 18:43:01.451462 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.451437    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"]
Jul 13 18:43:01.472799 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.472774    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"]
Jul 13 18:43:01.478071 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.478050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"
Jul 13 18:43:01.490816 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.490795    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"]
Jul 13 18:43:01.500107 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.500080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6540f97b-7d13-4aeb-a82f-2dfb5da80940-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-jk4mh\" (UID: \"6540f97b-7d13-4aeb-a82f-2dfb5da80940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"
Jul 13 18:43:01.500224 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.500136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33578512-0e18-412b-8a92-5538d0f3ef31-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-6kk7f\" (UID: \"33578512-0e18-412b-8a92-5538d0f3ef31\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"
Jul 13 18:43:01.500360 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.500326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mc4p\" (UniqueName: \"kubernetes.io/projected/33578512-0e18-412b-8a92-5538d0f3ef31-kube-api-access-7mc4p\") pod \"payload-pre-processing-74584bb9f8-6kk7f\" (UID: \"33578512-0e18-412b-8a92-5538d0f3ef31\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"
Jul 13 18:43:01.601219 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.601185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33578512-0e18-412b-8a92-5538d0f3ef31-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-6kk7f\" (UID: \"33578512-0e18-412b-8a92-5538d0f3ef31\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"
Jul 13 18:43:01.601219 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.601225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mc4p\" (UniqueName: \"kubernetes.io/projected/33578512-0e18-412b-8a92-5538d0f3ef31-kube-api-access-7mc4p\") pod \"payload-pre-processing-74584bb9f8-6kk7f\" (UID: \"33578512-0e18-412b-8a92-5538d0f3ef31\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"
Jul 13 18:43:01.601433 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.601274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzx82\" (UniqueName: \"kubernetes.io/projected/6540f97b-7d13-4aeb-a82f-2dfb5da80940-kube-api-access-nzx82\") pod \"payload-processing-f9b8d9b9b-jk4mh\" (UID: \"6540f97b-7d13-4aeb-a82f-2dfb5da80940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"
Jul 13 18:43:01.601433 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.601414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6540f97b-7d13-4aeb-a82f-2dfb5da80940-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-jk4mh\" (UID: \"6540f97b-7d13-4aeb-a82f-2dfb5da80940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"
Jul 13 18:43:01.602083 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.602059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33578512-0e18-412b-8a92-5538d0f3ef31-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-6kk7f\" (UID: \"33578512-0e18-412b-8a92-5538d0f3ef31\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"
Jul 13 18:43:01.602187 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.602172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6540f97b-7d13-4aeb-a82f-2dfb5da80940-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-jk4mh\" (UID: \"6540f97b-7d13-4aeb-a82f-2dfb5da80940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"
Jul 13 18:43:01.612349 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.612325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mc4p\" (UniqueName: \"kubernetes.io/projected/33578512-0e18-412b-8a92-5538d0f3ef31-kube-api-access-7mc4p\") pod \"payload-pre-processing-74584bb9f8-6kk7f\" (UID: \"33578512-0e18-412b-8a92-5538d0f3ef31\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"
Jul 13 18:43:01.702812 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.702737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzx82\" (UniqueName: \"kubernetes.io/projected/6540f97b-7d13-4aeb-a82f-2dfb5da80940-kube-api-access-nzx82\") pod \"payload-processing-f9b8d9b9b-jk4mh\" (UID: \"6540f97b-7d13-4aeb-a82f-2dfb5da80940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"
Jul 13 18:43:01.715947 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.715914    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzx82\" (UniqueName: \"kubernetes.io/projected/6540f97b-7d13-4aeb-a82f-2dfb5da80940-kube-api-access-nzx82\") pod \"payload-processing-f9b8d9b9b-jk4mh\" (UID: \"6540f97b-7d13-4aeb-a82f-2dfb5da80940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"
Jul 13 18:43:01.749250 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.749211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"
Jul 13 18:43:01.788110 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.788079    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"
Jul 13 18:43:01.924106 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.924080    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"]
Jul 13 18:43:01.927271 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:43:01.927225    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33578512_0e18_412b_8a92_5538d0f3ef31.slice/crio-d2bef3a152d14fccd25cbd0da685767331dad471f42149a5541303e970a971f5 WatchSource:0}: Error finding container d2bef3a152d14fccd25cbd0da685767331dad471f42149a5541303e970a971f5: Status 404 returned error can't find the container with id d2bef3a152d14fccd25cbd0da685767331dad471f42149a5541303e970a971f5
Jul 13 18:43:01.955929 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:01.955902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"]
Jul 13 18:43:01.957811 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:43:01.957784    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6540f97b_7d13_4aeb_a82f_2dfb5da80940.slice/crio-1560bc9cb6682d084b7df1eea6d426e6cfcce53dcd26d611acdacb30572a7f7d WatchSource:0}: Error finding container 1560bc9cb6682d084b7df1eea6d426e6cfcce53dcd26d611acdacb30572a7f7d: Status 404 returned error can't find the container with id 1560bc9cb6682d084b7df1eea6d426e6cfcce53dcd26d611acdacb30572a7f7d
Jul 13 18:43:02.251953 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:02.251865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh" event={"ID":"6540f97b-7d13-4aeb-a82f-2dfb5da80940","Type":"ContainerStarted","Data":"1560bc9cb6682d084b7df1eea6d426e6cfcce53dcd26d611acdacb30572a7f7d"}
Jul 13 18:43:02.253052 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:02.253026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f" event={"ID":"33578512-0e18-412b-8a92-5538d0f3ef31","Type":"ContainerStarted","Data":"d2bef3a152d14fccd25cbd0da685767331dad471f42149a5541303e970a971f5"}
Jul 13 18:43:04.263709 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:04.263664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh" event={"ID":"6540f97b-7d13-4aeb-a82f-2dfb5da80940","Type":"ContainerStarted","Data":"3767716faf19c0df3aeaa897984e2b91cdf128a4625a273889f01aee8fe91c93"}
Jul 13 18:43:04.264167 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:04.263788    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"
Jul 13 18:43:04.265245 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:04.265224    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f" event={"ID":"33578512-0e18-412b-8a92-5538d0f3ef31","Type":"ContainerStarted","Data":"dee1694ed07424e9b9aec21985171036e54b6a586a718c3e5ecf85251dbed9b6"}
Jul 13 18:43:04.265357 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:04.265270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"
Jul 13 18:43:04.284754 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:04.284700    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh" podStartSLOduration=1.7190751880000001 podStartE2EDuration="3.284680618s" totalImagesPullingTime="1.56560543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:43:04.281313201 +0000 UTC m=+671.368418667" watchObservedRunningTime="2026-07-13 18:43:04.284680618 +0000 UTC m=+671.371786084"
Jul 13 18:43:04.300809 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:04.300750    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f" podStartSLOduration=1.532363573 podStartE2EDuration="3.300731013s" totalImagesPullingTime="1.76836744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:43:04.299739053 +0000 UTC m=+671.386844547" watchObservedRunningTime="2026-07-13 18:43:04.300731013 +0000 UTC m=+671.387836479"
Jul 13 18:43:09.289428 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:09.289395    2565 generic.go:356] "Generic (PLEG): container finished" podID="0aaabb14-a750-4734-bb78-2f49e6ac7e03" containerID="51d529f204dd7832011b4c7e2e2958a13f54331d167c3fd3ffde122479bce809" exitCode=0
Jul 13 18:43:09.289942 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:09.289491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt" event={"ID":"0aaabb14-a750-4734-bb78-2f49e6ac7e03","Type":"ContainerDied","Data":"51d529f204dd7832011b4c7e2e2958a13f54331d167c3fd3ffde122479bce809"}
Jul 13 18:43:09.290037 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:09.289944    2565 scope.go:117] "RemoveContainer" containerID="51d529f204dd7832011b4c7e2e2958a13f54331d167c3fd3ffde122479bce809"
Jul 13 18:43:09.290947 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:09.290920    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:43:09.291009 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:09.290988    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:43:09.291065 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:09.291024    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:43:09.870947 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:09.870916    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:43:10.305845 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:10.305812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt" event={"ID":"0aaabb14-a750-4734-bb78-2f49e6ac7e03","Type":"ContainerStarted","Data":"58fcea1695d773572f2b58c64b3cb3a285e8f980a4c1c2f448cbe385a32cfa0d"}
Jul 13 18:43:10.635876 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:10.635781    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:43:10.637049 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:10.637026    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tn7vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 13 18:43:10.637167 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:10.637076    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt" podUID="0aaabb14-a750-4734-bb78-2f49e6ac7e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 13 18:43:11.635734 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:11.635693    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tn7vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 13 18:43:11.636137 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:11.635758    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt" podUID="0aaabb14-a750-4734-bb78-2f49e6ac7e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 13 18:43:12.635945 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:12.635907    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tn7vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 13 18:43:12.636314 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:12.635960    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt" podUID="0aaabb14-a750-4734-bb78-2f49e6ac7e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 13 18:43:13.636067 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:13.636037    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tn7vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 13 18:43:13.636536 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:13.636509    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt" podUID="0aaabb14-a750-4734-bb78-2f49e6ac7e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 13 18:43:14.639699 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:14.639660    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:43:14.640105 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:14.639926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:43:14.640682 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:14.640665    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tn7vt"
Jul 13 18:43:15.271613 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:15.271583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-jk4mh"
Jul 13 18:43:15.271820 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:15.271666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-6kk7f"
Jul 13 18:43:17.457020 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.456983    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"]
Jul 13 18:43:17.460422 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.460398    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.463141 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.463105    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 18:43:17.463246 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.463192    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z76zx\""
Jul 13 18:43:17.464084 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.464064    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 13 18:43:17.464200 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.464095    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 18:43:17.472501 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.472454    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"]
Jul 13 18:43:17.516538 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.516495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.516538 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.516544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.516760 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.516587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd5pm\" (UniqueName: \"kubernetes.io/projected/01f22cd9-a3de-4426-a970-4a268b8f4dbc-kube-api-access-jd5pm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.516760 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.516632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f22cd9-a3de-4426-a970-4a268b8f4dbc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.516760 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.516672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.516760 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.516690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.617387 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.617345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd5pm\" (UniqueName: \"kubernetes.io/projected/01f22cd9-a3de-4426-a970-4a268b8f4dbc-kube-api-access-jd5pm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.617387 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.617390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f22cd9-a3de-4426-a970-4a268b8f4dbc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.617638 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.617421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.617638 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.617441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.617638 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.617466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.617638 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.617516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.617893 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.617870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.617965 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.617881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.617965 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.617933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.619914 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.619890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01f22cd9-a3de-4426-a970-4a268b8f4dbc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.620543 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.620521    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f22cd9-a3de-4426-a970-4a268b8f4dbc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.625548 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.625527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd5pm\" (UniqueName: \"kubernetes.io/projected/01f22cd9-a3de-4426-a970-4a268b8f4dbc-kube-api-access-jd5pm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl\" (UID: \"01f22cd9-a3de-4426-a970-4a268b8f4dbc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.773076 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.772996    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:17.908868 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:17.908832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"]
Jul 13 18:43:17.912548 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:43:17.912520    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f22cd9_a3de_4426_a970_4a268b8f4dbc.slice/crio-7c53de92f4b5e1b90ed7ac1e5c2f5aa68563ed5f04eb2147dc9ab1391d555337 WatchSource:0}: Error finding container 7c53de92f4b5e1b90ed7ac1e5c2f5aa68563ed5f04eb2147dc9ab1391d555337: Status 404 returned error can't find the container with id 7c53de92f4b5e1b90ed7ac1e5c2f5aa68563ed5f04eb2147dc9ab1391d555337
Jul 13 18:43:18.354526 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:18.354462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl" event={"ID":"01f22cd9-a3de-4426-a970-4a268b8f4dbc","Type":"ContainerStarted","Data":"7c53de92f4b5e1b90ed7ac1e5c2f5aa68563ed5f04eb2147dc9ab1391d555337"}
Jul 13 18:43:19.360780 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:19.360691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl" event={"ID":"01f22cd9-a3de-4426-a970-4a268b8f4dbc","Type":"ContainerStarted","Data":"c0de0ce31e69ee21c7cdc725d8ce9328ee0a312ff0aca25ee8c8e1e78fb91256"}
Jul 13 18:43:19.382294 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:19.382244    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl" podStartSLOduration=1.310606945 podStartE2EDuration="2.382227237s" totalImagesPullingTime="1.071620292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:43:19.380792596 +0000 UTC m=+686.467898066" watchObservedRunningTime="2026-07-13 18:43:19.382227237 +0000 UTC m=+686.469332702"
Jul 13 18:43:27.773152 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:27.773110    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:27.773631 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:27.773316    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:27.785972 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:27.785943    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:28.416731 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:28.416702    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl"
Jul 13 18:43:43.366390 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.366356    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"]
Jul 13 18:43:43.372084 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.372064    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.374889 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.374871    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 13 18:43:43.383190 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.383168    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"]
Jul 13 18:43:43.407696 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.407665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.407789 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.407707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.407789 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.407765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xcsr\" (UniqueName: \"kubernetes.io/projected/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-kube-api-access-4xcsr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.407789 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.407785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.407933 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.407873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.407933 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.407925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.508306 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.508277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.508516 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.508331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.508516 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.508382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.508617 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.508521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.508617 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.508556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.508705 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.508612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xcsr\" (UniqueName: \"kubernetes.io/projected/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-kube-api-access-4xcsr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.508940 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.508904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.508940 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.508921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.509126 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.508970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.511049 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.511029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.511256 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.511229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.517419 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.517397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xcsr\" (UniqueName: \"kubernetes.io/projected/8c78fbc3-ad9e-42a3-9817-39e3af8471f0-kube-api-access-4xcsr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6\" (UID: \"8c78fbc3-ad9e-42a3-9817-39e3af8471f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.682177 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.682144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:43.819584 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.819517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"]
Jul 13 18:43:43.822310 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:43:43.822280    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c78fbc3_ad9e_42a3_9817_39e3af8471f0.slice/crio-9a320d1f273af0813ac9c697842a5b1424579460a45a809338a22cfd26383b0d WatchSource:0}: Error finding container 9a320d1f273af0813ac9c697842a5b1424579460a45a809338a22cfd26383b0d: Status 404 returned error can't find the container with id 9a320d1f273af0813ac9c697842a5b1424579460a45a809338a22cfd26383b0d
Jul 13 18:43:43.823546 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:43.823527    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 18:43:44.473526 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:44.473485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6" event={"ID":"8c78fbc3-ad9e-42a3-9817-39e3af8471f0","Type":"ContainerStarted","Data":"5ba58bb276937543a61610ffb9652bbd2dc473bd9dcec7cafbf29fc001913d64"}
Jul 13 18:43:44.473986 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:44.473553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6" event={"ID":"8c78fbc3-ad9e-42a3-9817-39e3af8471f0","Type":"ContainerStarted","Data":"9a320d1f273af0813ac9c697842a5b1424579460a45a809338a22cfd26383b0d"}
Jul 13 18:43:44.492839 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:44.492750    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6" podStartSLOduration=1.293991123 podStartE2EDuration="1.492734526s" totalImagesPullingTime="198.743403ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:43:44.491834136 +0000 UTC m=+711.578939630" watchObservedRunningTime="2026-07-13 18:43:44.492734526 +0000 UTC m=+711.579839990"
Jul 13 18:43:53.682482 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:53.682426    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:53.682841 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:53.682511    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:53.694697 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:53.694671    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:43:54.530077 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:43:54.530043    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6"
Jul 13 18:44:29.859506 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:29.859454    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"]
Jul 13 18:44:29.862689 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:29.862666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:29.866002 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:29.865981    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 13 18:44:29.875666 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:29.875646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"]
Jul 13 18:44:30.013321 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.013279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.013321 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.013326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.013599 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.013392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b598a44b-6d98-456e-8f11-181649d4d87d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.013599 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.013443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.013599 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.013546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.013733 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.013609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjf6t\" (UniqueName: \"kubernetes.io/projected/b598a44b-6d98-456e-8f11-181649d4d87d-kube-api-access-qjf6t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.114491 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.114389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b598a44b-6d98-456e-8f11-181649d4d87d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.114491 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.114441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.114681 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.114500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.114681 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.114544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjf6t\" (UniqueName: \"kubernetes.io/projected/b598a44b-6d98-456e-8f11-181649d4d87d-kube-api-access-qjf6t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.114681 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.114580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.114681 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.114605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.114937 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.114914    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.115250 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.114930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.115250 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.114963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.116944 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.116926    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b598a44b-6d98-456e-8f11-181649d4d87d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.117197 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.117180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b598a44b-6d98-456e-8f11-181649d4d87d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.122753 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.122733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjf6t\" (UniqueName: \"kubernetes.io/projected/b598a44b-6d98-456e-8f11-181649d4d87d-kube-api-access-qjf6t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9\" (UID: \"b598a44b-6d98-456e-8f11-181649d4d87d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.172292 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.172264    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:30.309022 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.308997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"]
Jul 13 18:44:30.311281 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:44:30.311253    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb598a44b_6d98_456e_8f11_181649d4d87d.slice/crio-4693cd3f69dedc02e1fd1a93127a047f0885523ca9add967b52f21772c9b21c2 WatchSource:0}: Error finding container 4693cd3f69dedc02e1fd1a93127a047f0885523ca9add967b52f21772c9b21c2: Status 404 returned error can't find the container with id 4693cd3f69dedc02e1fd1a93127a047f0885523ca9add967b52f21772c9b21c2
Jul 13 18:44:30.676855 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.676816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9" event={"ID":"b598a44b-6d98-456e-8f11-181649d4d87d","Type":"ContainerStarted","Data":"80e8d532446e922fe0ad220457429003566e804e509c1b283ea66e32dfaf5a7a"}
Jul 13 18:44:30.676855 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.676863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9" event={"ID":"b598a44b-6d98-456e-8f11-181649d4d87d","Type":"ContainerStarted","Data":"4693cd3f69dedc02e1fd1a93127a047f0885523ca9add967b52f21772c9b21c2"}
Jul 13 18:44:30.713147 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:30.713086    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9" podStartSLOduration=1.5158348350000002 podStartE2EDuration="1.713070519s" totalImagesPullingTime="197.235684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:44:30.709847732 +0000 UTC m=+757.796953196" watchObservedRunningTime="2026-07-13 18:44:30.713070519 +0000 UTC m=+757.800175983"
Jul 13 18:44:40.173527 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:40.173459    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:40.173942 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:40.173545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:40.186294 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:40.186270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:44:40.733582 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:44:40.733552    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9"
Jul 13 18:46:53.342082 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:53.342047    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:46:53.342587 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:53.342212    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:46:53.347076 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:53.347051    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:46:53.347257 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:53.347240    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:46:53.867588 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:53.867549    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d9b58f676-6b9kq"]
Jul 13 18:46:53.867838 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:53.867807    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d9b58f676-6b9kq" podUID="67f55337-839d-4e0d-906c-a6462b7a06a5" containerName="manager" containerID="cri-o://c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced" gracePeriod=30
Jul 13 18:46:54.126600 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.126542    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:46:54.260225 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.260190    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67f55337-839d-4e0d-906c-a6462b7a06a5-webhook-cert\") pod \"67f55337-839d-4e0d-906c-a6462b7a06a5\" (UID: \"67f55337-839d-4e0d-906c-a6462b7a06a5\") "
Jul 13 18:46:54.260396 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.260233    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bl9x\" (UniqueName: \"kubernetes.io/projected/67f55337-839d-4e0d-906c-a6462b7a06a5-kube-api-access-5bl9x\") pod \"67f55337-839d-4e0d-906c-a6462b7a06a5\" (UID: \"67f55337-839d-4e0d-906c-a6462b7a06a5\") "
Jul 13 18:46:54.262433 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.262406    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67f55337-839d-4e0d-906c-a6462b7a06a5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "67f55337-839d-4e0d-906c-a6462b7a06a5" (UID: "67f55337-839d-4e0d-906c-a6462b7a06a5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:46:54.262538 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.262444    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67f55337-839d-4e0d-906c-a6462b7a06a5-kube-api-access-5bl9x" (OuterVolumeSpecName: "kube-api-access-5bl9x") pod "67f55337-839d-4e0d-906c-a6462b7a06a5" (UID: "67f55337-839d-4e0d-906c-a6462b7a06a5"). InnerVolumeSpecName "kube-api-access-5bl9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:46:54.320365 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.320337    2565 generic.go:356] "Generic (PLEG): container finished" podID="67f55337-839d-4e0d-906c-a6462b7a06a5" containerID="c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced" exitCode=0
Jul 13 18:46:54.320508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.320375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d9b58f676-6b9kq" event={"ID":"67f55337-839d-4e0d-906c-a6462b7a06a5","Type":"ContainerDied","Data":"c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced"}
Jul 13 18:46:54.320508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.320384    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d9b58f676-6b9kq"
Jul 13 18:46:54.320508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.320411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d9b58f676-6b9kq" event={"ID":"67f55337-839d-4e0d-906c-a6462b7a06a5","Type":"ContainerDied","Data":"ce56b3c4ee9a34ecd2738bfa2e8ea8b6088638a44f24e851fa12f403983c4f6f"}
Jul 13 18:46:54.320508 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.320432    2565 scope.go:117] "RemoveContainer" containerID="c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced"
Jul 13 18:46:54.329601 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.329582    2565 scope.go:117] "RemoveContainer" containerID="c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced"
Jul 13 18:46:54.329840 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:46:54.329821    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced\": container with ID starting with c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced not found: ID does not exist" containerID="c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced"
Jul 13 18:46:54.329884 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.329851    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced"} err="failed to get container status \"c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced\": rpc error: code = NotFound desc = could not find container \"c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced\": container with ID starting with c98a4681858ae94b9d8b3468f31c1b44a4c70cf4ed7730cc521f5e4d1104dced not found: ID does not exist"
Jul 13 18:46:54.342441 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.342421    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d9b58f676-6b9kq"]
Jul 13 18:46:54.346109 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.346078    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d9b58f676-6b9kq"]
Jul 13 18:46:54.360934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.360911    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67f55337-839d-4e0d-906c-a6462b7a06a5-webhook-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:46:54.360934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:54.360930    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bl9x\" (UniqueName: \"kubernetes.io/projected/67f55337-839d-4e0d-906c-a6462b7a06a5-kube-api-access-5bl9x\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:46:55.178543 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.178507    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d9b58f676-27h2f"]
Jul 13 18:46:55.179007 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.178884    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67f55337-839d-4e0d-906c-a6462b7a06a5" containerName="manager"
Jul 13 18:46:55.179007 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.178896    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="67f55337-839d-4e0d-906c-a6462b7a06a5" containerName="manager"
Jul 13 18:46:55.179007 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.178952    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="67f55337-839d-4e0d-906c-a6462b7a06a5" containerName="manager"
Jul 13 18:46:55.183298 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.183274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d9b58f676-27h2f"
Jul 13 18:46:55.187444 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.187421    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 18:46:55.187803 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.187783    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 18:46:55.188677 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.188654    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-l5fz5\""
Jul 13 18:46:55.199353 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.199328    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d9b58f676-27h2f"]
Jul 13 18:46:55.267976 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.267934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2cc04771-072c-4a22-843f-d5ba14513903-webhook-cert\") pod \"maas-controller-d9b58f676-27h2f\" (UID: \"2cc04771-072c-4a22-843f-d5ba14513903\") " pod="opendatahub/maas-controller-d9b58f676-27h2f"
Jul 13 18:46:55.268145 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.268013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdwnb\" (UniqueName: \"kubernetes.io/projected/2cc04771-072c-4a22-843f-d5ba14513903-kube-api-access-cdwnb\") pod \"maas-controller-d9b58f676-27h2f\" (UID: \"2cc04771-072c-4a22-843f-d5ba14513903\") " pod="opendatahub/maas-controller-d9b58f676-27h2f"
Jul 13 18:46:55.368977 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.368939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdwnb\" (UniqueName: \"kubernetes.io/projected/2cc04771-072c-4a22-843f-d5ba14513903-kube-api-access-cdwnb\") pod \"maas-controller-d9b58f676-27h2f\" (UID: \"2cc04771-072c-4a22-843f-d5ba14513903\") " pod="opendatahub/maas-controller-d9b58f676-27h2f"
Jul 13 18:46:55.369393 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.369026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2cc04771-072c-4a22-843f-d5ba14513903-webhook-cert\") pod \"maas-controller-d9b58f676-27h2f\" (UID: \"2cc04771-072c-4a22-843f-d5ba14513903\") " pod="opendatahub/maas-controller-d9b58f676-27h2f"
Jul 13 18:46:55.371572 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.371540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2cc04771-072c-4a22-843f-d5ba14513903-webhook-cert\") pod \"maas-controller-d9b58f676-27h2f\" (UID: \"2cc04771-072c-4a22-843f-d5ba14513903\") " pod="opendatahub/maas-controller-d9b58f676-27h2f"
Jul 13 18:46:55.378251 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.378226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdwnb\" (UniqueName: \"kubernetes.io/projected/2cc04771-072c-4a22-843f-d5ba14513903-kube-api-access-cdwnb\") pod \"maas-controller-d9b58f676-27h2f\" (UID: \"2cc04771-072c-4a22-843f-d5ba14513903\") " pod="opendatahub/maas-controller-d9b58f676-27h2f"
Jul 13 18:46:55.465293 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.465202    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67f55337-839d-4e0d-906c-a6462b7a06a5" path="/var/lib/kubelet/pods/67f55337-839d-4e0d-906c-a6462b7a06a5/volumes"
Jul 13 18:46:55.493593 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.493562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d9b58f676-27h2f"
Jul 13 18:46:55.636966 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:55.636932    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d9b58f676-27h2f"]
Jul 13 18:46:55.640044 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:46:55.640018    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc04771_072c_4a22_843f_d5ba14513903.slice/crio-24f748206c1c4c504f5580e3ed4aabac8f07f20cf5d2fe3f8c9e834cd355db96 WatchSource:0}: Error finding container 24f748206c1c4c504f5580e3ed4aabac8f07f20cf5d2fe3f8c9e834cd355db96: Status 404 returned error can't find the container with id 24f748206c1c4c504f5580e3ed4aabac8f07f20cf5d2fe3f8c9e834cd355db96
Jul 13 18:46:56.332371 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:56.332327    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d9b58f676-27h2f" event={"ID":"2cc04771-072c-4a22-843f-d5ba14513903","Type":"ContainerStarted","Data":"24f748206c1c4c504f5580e3ed4aabac8f07f20cf5d2fe3f8c9e834cd355db96"}
Jul 13 18:46:57.341369 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:57.341324    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d9b58f676-27h2f" event={"ID":"2cc04771-072c-4a22-843f-d5ba14513903","Type":"ContainerStarted","Data":"2a6ef24cbb1327439d68660e5ec67ab26be08a5b4e453036e621bbe3c3faee70"}
Jul 13 18:46:57.342009 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:57.341462    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d9b58f676-27h2f"
Jul 13 18:46:57.359738 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:46:57.359675    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d9b58f676-27h2f" podStartSLOduration=0.861315563 podStartE2EDuration="2.359657226s" totalImagesPullingTime="1.498341663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:46:57.358649325 +0000 UTC m=+904.445754810" watchObservedRunningTime="2026-07-13 18:46:57.359657226 +0000 UTC m=+904.446762713"
Jul 13 18:47:08.347185 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:47:08.347155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d9b58f676-27h2f"
Jul 13 18:51:43.963428 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:43.963336    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"]
Jul 13 18:51:43.964022 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:43.963564    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr" podUID="32afa50e-9762-4358-b34b-3740cc3957a0" containerName="manager" containerID="cri-o://20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911" gracePeriod=10
Jul 13 18:51:47.314526 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.314500    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:51:47.443407 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.443321    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cp59t\" (UniqueName: \"kubernetes.io/projected/32afa50e-9762-4358-b34b-3740cc3957a0-kube-api-access-cp59t\") pod \"32afa50e-9762-4358-b34b-3740cc3957a0\" (UID: \"32afa50e-9762-4358-b34b-3740cc3957a0\") "
Jul 13 18:51:47.443407 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.443381    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32afa50e-9762-4358-b34b-3740cc3957a0-extensions-socket-volume\") pod \"32afa50e-9762-4358-b34b-3740cc3957a0\" (UID: \"32afa50e-9762-4358-b34b-3740cc3957a0\") "
Jul 13 18:51:47.443783 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.443759    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32afa50e-9762-4358-b34b-3740cc3957a0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "32afa50e-9762-4358-b34b-3740cc3957a0" (UID: "32afa50e-9762-4358-b34b-3740cc3957a0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:51:47.445531 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.445508    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32afa50e-9762-4358-b34b-3740cc3957a0-kube-api-access-cp59t" (OuterVolumeSpecName: "kube-api-access-cp59t") pod "32afa50e-9762-4358-b34b-3740cc3957a0" (UID: "32afa50e-9762-4358-b34b-3740cc3957a0"). InnerVolumeSpecName "kube-api-access-cp59t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:51:47.544539 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.544462    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cp59t\" (UniqueName: \"kubernetes.io/projected/32afa50e-9762-4358-b34b-3740cc3957a0-kube-api-access-cp59t\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:51:47.544539 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.544529    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32afa50e-9762-4358-b34b-3740cc3957a0-extensions-socket-volume\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 18:51:47.698146 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.698055    2565 generic.go:356] "Generic (PLEG): container finished" podID="32afa50e-9762-4358-b34b-3740cc3957a0" containerID="20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911" exitCode=0
Jul 13 18:51:47.698146 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.698104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr" event={"ID":"32afa50e-9762-4358-b34b-3740cc3957a0","Type":"ContainerDied","Data":"20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911"}
Jul 13 18:51:47.698146 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.698110    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"
Jul 13 18:51:47.698362 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.698169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr" event={"ID":"32afa50e-9762-4358-b34b-3740cc3957a0","Type":"ContainerDied","Data":"4a9ea15b8a14940c8107cf322c9ec131b7371ddeeebd10469e6bb8582eab0138"}
Jul 13 18:51:47.698362 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.698199    2565 scope.go:117] "RemoveContainer" containerID="20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911"
Jul 13 18:51:47.707417 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.707398    2565 scope.go:117] "RemoveContainer" containerID="20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911"
Jul 13 18:51:47.707665 ip-10-0-131-162 kubenswrapper[2565]: E0713 18:51:47.707647    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911\": container with ID starting with 20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911 not found: ID does not exist" containerID="20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911"
Jul 13 18:51:47.707740 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.707673    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911"} err="failed to get container status \"20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911\": rpc error: code = NotFound desc = could not find container \"20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911\": container with ID starting with 20e4c667a3d8af63f25847b1e95dec3a83abba8adf3fb55ea90a9010cdd1f911 not found: ID does not exist"
Jul 13 18:51:47.716319 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.716297    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"]
Jul 13 18:51:47.723392 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:47.723373    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgxjr"]
Jul 13 18:51:49.465744 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:49.465716    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32afa50e-9762-4358-b34b-3740cc3957a0" path="/var/lib/kubelet/pods/32afa50e-9762-4358-b34b-3740cc3957a0/volumes"
Jul 13 18:51:53.368143 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:53.368113    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:51:53.368887 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:53.368865    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:51:53.379043 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:53.379022    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:51:53.380066 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:51:53.380047    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:52:45.435641 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.435565    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"]
Jul 13 18:52:45.436074 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.435972    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32afa50e-9762-4358-b34b-3740cc3957a0" containerName="manager"
Jul 13 18:52:45.436074 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.435985    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="32afa50e-9762-4358-b34b-3740cc3957a0" containerName="manager"
Jul 13 18:52:45.436074 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.436056    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="32afa50e-9762-4358-b34b-3740cc3957a0" containerName="manager"
Jul 13 18:52:45.439252 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.439235    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"
Jul 13 18:52:45.442651 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.442631    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hv92m\""
Jul 13 18:52:45.451036 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.451015    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"]
Jul 13 18:52:45.530390 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.530358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6d3526e-ccb1-4129-a077-776c495edccd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mkq5z\" (UID: \"c6d3526e-ccb1-4129-a077-776c495edccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"
Jul 13 18:52:45.530587 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.530421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbcj9\" (UniqueName: \"kubernetes.io/projected/c6d3526e-ccb1-4129-a077-776c495edccd-kube-api-access-lbcj9\") pod \"kuadrant-operator-controller-manager-86878c769f-mkq5z\" (UID: \"c6d3526e-ccb1-4129-a077-776c495edccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"
Jul 13 18:52:45.631739 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.631715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbcj9\" (UniqueName: \"kubernetes.io/projected/c6d3526e-ccb1-4129-a077-776c495edccd-kube-api-access-lbcj9\") pod \"kuadrant-operator-controller-manager-86878c769f-mkq5z\" (UID: \"c6d3526e-ccb1-4129-a077-776c495edccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"
Jul 13 18:52:45.631887 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.631815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6d3526e-ccb1-4129-a077-776c495edccd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mkq5z\" (UID: \"c6d3526e-ccb1-4129-a077-776c495edccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"
Jul 13 18:52:45.632191 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.632174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6d3526e-ccb1-4129-a077-776c495edccd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mkq5z\" (UID: \"c6d3526e-ccb1-4129-a077-776c495edccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"
Jul 13 18:52:45.658342 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.658311    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbcj9\" (UniqueName: \"kubernetes.io/projected/c6d3526e-ccb1-4129-a077-776c495edccd-kube-api-access-lbcj9\") pod \"kuadrant-operator-controller-manager-86878c769f-mkq5z\" (UID: \"c6d3526e-ccb1-4129-a077-776c495edccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"
Jul 13 18:52:45.749091 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.749018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"
Jul 13 18:52:45.896727 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.896697    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"]
Jul 13 18:52:45.899964 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:52:45.899937    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d3526e_ccb1_4129_a077_776c495edccd.slice/crio-aeceb43ef6e9ce3c99f41e47d8df8c9a6dabb7f244378d39010e9532e0c8267d WatchSource:0}: Error finding container aeceb43ef6e9ce3c99f41e47d8df8c9a6dabb7f244378d39010e9532e0c8267d: Status 404 returned error can't find the container with id aeceb43ef6e9ce3c99f41e47d8df8c9a6dabb7f244378d39010e9532e0c8267d
Jul 13 18:52:45.958443 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:45.958409    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z" event={"ID":"c6d3526e-ccb1-4129-a077-776c495edccd","Type":"ContainerStarted","Data":"aeceb43ef6e9ce3c99f41e47d8df8c9a6dabb7f244378d39010e9532e0c8267d"}
Jul 13 18:52:46.965309 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:46.965270    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z" event={"ID":"c6d3526e-ccb1-4129-a077-776c495edccd","Type":"ContainerStarted","Data":"a3b29030caae9a18e78f57ebea7d7de77b6349b194e9a884820b728bf4ee135d"}
Jul 13 18:52:46.965708 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:46.965394    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"
Jul 13 18:52:46.987157 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:46.987105    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z" podStartSLOduration=1.987088771 podStartE2EDuration="1.987088771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:52:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:46.984723744 +0000 UTC m=+1254.071829209" watchObservedRunningTime="2026-07-13 18:52:46.987088771 +0000 UTC m=+1254.074194236"
Jul 13 18:52:57.972332 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:52:57.972286    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkq5z"
Jul 13 18:56:53.400033 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:56:53.400001    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:56:53.402156 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:56:53.402135    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 18:56:53.404983 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:56:53.404966    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:56:53.407146 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:56:53.407130    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 18:59:13.593650 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.593618    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"]
Jul 13 18:59:13.597147 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.597126    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.599837 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.599815    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f7c6e726-openshift-default-dockercfg-vgkg2\""
Jul 13 18:59:13.627853 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.627823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"]
Jul 13 18:59:13.674200 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.674167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-socket\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.674370 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.674213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmzgw\" (UniqueName: \"kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-kube-api-access-lmzgw\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.674370 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.674235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-token\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.674370 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.674250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istiod-ca-cert\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.674370 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.674269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-credential-socket\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.674583 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.674373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-podinfo\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.674583 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.674412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-envoy\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.674583 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.674434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-certs\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.674583 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.674496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-data\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.775755 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.775699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-data\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.775934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.775769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-socket\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.775934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.775790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzgw\" (UniqueName: \"kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-kube-api-access-lmzgw\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.775934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.775810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-token\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.775934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.775824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istiod-ca-cert\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.775934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.775843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-credential-socket\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.775934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.775877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-podinfo\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.775934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.775903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-envoy\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.775934 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.775933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-certs\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.776342 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.776170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-data\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.776342 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.776214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-socket\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.776342 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.776268    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-certs\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.776450 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.776373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-credential-socket\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.776970 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.776913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istiod-ca-cert\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.778653 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.778621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-envoy\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.778853 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.778835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-podinfo\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.783788 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.783757    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-token\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.784125 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.784105    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzgw\" (UniqueName: \"kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-kube-api-access-lmzgw\") pod \"e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") " pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:13.906967 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:13.906931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:14.051630 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:14.051598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"]
Jul 13 18:59:14.053997 ip-10-0-131-162 kubenswrapper[2565]: W0713 18:59:14.053969    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode870590e_4f57_41fe_80cb_ba1d8fd2ac9c.slice/crio-54d372de20e961305355df6bcbfccdc746f1a0dde202b40ae6729c6d8a56bc46 WatchSource:0}: Error finding container 54d372de20e961305355df6bcbfccdc746f1a0dde202b40ae6729c6d8a56bc46: Status 404 returned error can't find the container with id 54d372de20e961305355df6bcbfccdc746f1a0dde202b40ae6729c6d8a56bc46
Jul 13 18:59:14.056056 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:14.056020    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:59:14.056204 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:14.056095    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:59:14.056204 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:14.056123    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:59:14.758976 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:14.758936    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" event={"ID":"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c","Type":"ContainerStarted","Data":"1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709"}
Jul 13 18:59:14.759387 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:14.758993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" event={"ID":"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c","Type":"ContainerStarted","Data":"54d372de20e961305355df6bcbfccdc746f1a0dde202b40ae6729c6d8a56bc46"}
Jul 13 18:59:14.792278 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:14.792202    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" podStartSLOduration=1.7921825390000001 podStartE2EDuration="1.792182539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:14.791320695 +0000 UTC m=+1641.878426217" watchObservedRunningTime="2026-07-13 18:59:14.792182539 +0000 UTC m=+1641.879288006"
Jul 13 18:59:14.907835 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:14.907798    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:15.912312 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:15.912284    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:16.768816 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:16.768785    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:16.769677 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:16.769658    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:26.833346 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:26.833313    2565 generic.go:356] "Generic (PLEG): container finished" podID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerID="1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709" exitCode=0
Jul 13 18:59:26.833764 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:26.833392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" event={"ID":"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c","Type":"ContainerDied","Data":"1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709"}
Jul 13 18:59:26.833892 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:26.833873    2565 scope.go:117] "RemoveContainer" containerID="1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709"
Jul 13 18:59:26.834864 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:26.834832    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:59:26.834920 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:26.834904    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:59:26.834954 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:26.834935    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 18:59:27.840067 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:27.840024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" event={"ID":"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c","Type":"ContainerStarted","Data":"fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c"}
Jul 13 18:59:27.908055 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:27.908015    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:27.909236 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:27.909212    2565 patch_prober.go:28] interesting pod/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 13 18:59:27.909353 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:27.909274    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 13 18:59:28.908304 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:28.908260    2565 patch_prober.go:28] interesting pod/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 13 18:59:28.908681 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:28.908328    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 13 18:59:29.908143 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:29.908109    2565 patch_prober.go:28] interesting pod/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 13 18:59:29.908341 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:29.908171    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 13 18:59:30.907621 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:30.907584    2565 patch_prober.go:28] interesting pod/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 13 18:59:30.907807 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:30.907640    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 13 18:59:31.769616 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:31.769581    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:31.908229 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:31.908182    2565 patch_prober.go:28] interesting pod/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 13 18:59:31.908403 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:31.908252    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 13 18:59:32.908228 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:32.908188    2565 patch_prober.go:28] interesting pod/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 13 18:59:32.908642 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:32.908247    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 13 18:59:33.911524 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:33.911495    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 18:59:33.912437 ip-10-0-131-162 kubenswrapper[2565]: I0713 18:59:33.912420    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 19:00:35.141241 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:35.141206    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"]
Jul 13 19:00:35.141698 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:35.141431    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy" containerID="cri-o://fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c" gracePeriod=30
Jul 13 19:00:40.389622 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.389596    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 19:00:40.444052 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.443959    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-credential-socket\") pod \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") "
Jul 13 19:00:40.444052 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444046    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-certs\") pod \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") "
Jul 13 19:00:40.444277 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444075    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-data\") pod \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") "
Jul 13 19:00:40.444277 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444112    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmzgw\" (UniqueName: \"kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-kube-api-access-lmzgw\") pod \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") "
Jul 13 19:00:40.444277 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-token\") pod \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") "
Jul 13 19:00:40.444277 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444199    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-envoy\") pod \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") "
Jul 13 19:00:40.444277 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444246    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istiod-ca-cert\") pod \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") "
Jul 13 19:00:40.444582 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444275    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" (UID: "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:00:40.444582 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444292    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-socket\") pod \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") "
Jul 13 19:00:40.444582 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444286    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" (UID: "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:00:40.444582 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444339    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-podinfo\") pod \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\" (UID: \"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c\") "
Jul 13 19:00:40.444790 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444697    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-credential-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:00:40.444790 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444720    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:00:40.445275 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.444974    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" (UID: "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:00:40.445275 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.445229    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" (UID: "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:00:40.445445 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.445390    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-data" (OuterVolumeSpecName: "istio-data") pod "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" (UID: "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:00:40.447148 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.447095    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" (UID: "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:00:40.447253 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.447174    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-kube-api-access-lmzgw" (OuterVolumeSpecName: "kube-api-access-lmzgw") pod "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" (UID: "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c"). InnerVolumeSpecName "kube-api-access-lmzgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:00:40.447253 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.447199    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" (UID: "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:00:40.447533 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.447507    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-token" (OuterVolumeSpecName: "istio-token") pod "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" (UID: "e870590e-4f57-41fe-80cb-ba1d8fd2ac9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:00:40.545202 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.545167    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-token\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:00:40.545202 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.545198    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-envoy\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:00:40.545202 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.545207    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istiod-ca-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:00:40.545502 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.545215    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-workload-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:00:40.545502 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.545224    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-podinfo\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:00:40.545502 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.545233    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-istio-data\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:00:40.545502 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:40.545240    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmzgw\" (UniqueName: \"kubernetes.io/projected/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c-kube-api-access-lmzgw\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:00:41.195315 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.195272    2565 generic.go:356] "Generic (PLEG): container finished" podID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerID="fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c" exitCode=0
Jul 13 19:00:41.195557 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.195337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" event={"ID":"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c","Type":"ContainerDied","Data":"fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c"}
Jul 13 19:00:41.195557 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.195349    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"
Jul 13 19:00:41.195557 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.195434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2" event={"ID":"e870590e-4f57-41fe-80cb-ba1d8fd2ac9c","Type":"ContainerDied","Data":"54d372de20e961305355df6bcbfccdc746f1a0dde202b40ae6729c6d8a56bc46"}
Jul 13 19:00:41.195557 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.195491    2565 scope.go:117] "RemoveContainer" containerID="fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c"
Jul 13 19:00:41.205094 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.205074    2565 scope.go:117] "RemoveContainer" containerID="1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709"
Jul 13 19:00:41.213041 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.213024    2565 scope.go:117] "RemoveContainer" containerID="fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c"
Jul 13 19:00:41.213283 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:00:41.213267    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c\": container with ID starting with fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c not found: ID does not exist" containerID="fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c"
Jul 13 19:00:41.213322 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.213292    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c"} err="failed to get container status \"fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c\": rpc error: code = NotFound desc = could not find container \"fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c\": container with ID starting with fd17e05e621e844f7881887b5d0e5cf441e346d6d6f97770a1b3d777a8c7573c not found: ID does not exist"
Jul 13 19:00:41.213322 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.213310    2565 scope.go:117] "RemoveContainer" containerID="1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709"
Jul 13 19:00:41.213519 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:00:41.213505    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709\": container with ID starting with 1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709 not found: ID does not exist" containerID="1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709"
Jul 13 19:00:41.213563 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.213523    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709"} err="failed to get container status \"1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709\": rpc error: code = NotFound desc = could not find container \"1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709\": container with ID starting with 1d90c6aec911cd3222d18598dfa509ee9265e7f02c0eea9163a6ceaac0d79709 not found: ID does not exist"
Jul 13 19:00:41.219256 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.219233    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"]
Jul 13 19:00:41.224241 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.224221    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f7c6e726-openshift-default-d7595c859-bvzt2"]
Jul 13 19:00:41.464972 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.464896    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" path="/var/lib/kubelet/pods/e870590e-4f57-41fe-80cb-ba1d8fd2ac9c/volumes"
Jul 13 19:00:41.517991 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.517950    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"]
Jul 13 19:00:41.518365 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.518347    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy"
Jul 13 19:00:41.518448 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.518366    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy"
Jul 13 19:00:41.518535 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.518522    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy"
Jul 13 19:00:41.521573 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.521550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"
Jul 13 19:00:41.523988 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.523969    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 19:00:41.524098 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.524048    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lkrf8\""
Jul 13 19:00:41.528858 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.528837    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"]
Jul 13 19:00:41.555517 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.555487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8aa353d-056b-4d96-8932-2e0f91d1ce15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-78327326-bmq96\" (UID: \"e8aa353d-056b-4d96-8932-2e0f91d1ce15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"
Jul 13 19:00:41.655932 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.655892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8aa353d-056b-4d96-8932-2e0f91d1ce15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-78327326-bmq96\" (UID: \"e8aa353d-056b-4d96-8932-2e0f91d1ce15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"
Jul 13 19:00:41.656609 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.656586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8aa353d-056b-4d96-8932-2e0f91d1ce15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-78327326-bmq96\" (UID: \"e8aa353d-056b-4d96-8932-2e0f91d1ce15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"
Jul 13 19:00:41.834129 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.834099    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"
Jul 13 19:00:41.986539 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.986506    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"]
Jul 13 19:00:41.989029 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:00:41.988989    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8aa353d_056b_4d96_8932_2e0f91d1ce15.slice/crio-f99c45ab81cffc1d480bed48319fc78543cc46aeca654641adc5f35581c50a09 WatchSource:0}: Error finding container f99c45ab81cffc1d480bed48319fc78543cc46aeca654641adc5f35581c50a09: Status 404 returned error can't find the container with id f99c45ab81cffc1d480bed48319fc78543cc46aeca654641adc5f35581c50a09
Jul 13 19:00:41.991016 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:41.990996    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:00:42.202912 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:00:42.202877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96" event={"ID":"e8aa353d-056b-4d96-8932-2e0f91d1ce15","Type":"ContainerStarted","Data":"f99c45ab81cffc1d480bed48319fc78543cc46aeca654641adc5f35581c50a09"}
Jul 13 19:01:53.426750 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:53.426724    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 19:01:53.430141 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:53.430117    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 19:01:53.432179 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:53.432158    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 19:01:53.435601 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:53.435582    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 19:01:55.220814 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.220780    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"]
Jul 13 19:01:55.221255 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.221239    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy"
Jul 13 19:01:55.221255 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.221256    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy"
Jul 13 19:01:55.221357 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.221343    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e870590e-4f57-41fe-80cb-ba1d8fd2ac9c" containerName="istio-proxy"
Jul 13 19:01:55.224515 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.224494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.227664 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.227645    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-258c642c-openshift-default-dockercfg-wnrqk\""
Jul 13 19:01:55.243331 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.243296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"]
Jul 13 19:01:55.302872 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.302835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-socket\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.302872 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.302876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-data\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.303120 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.302900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlxlf\" (UniqueName: \"kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-kube-api-access-zlxlf\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.303120 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.302982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-certs\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.303120 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.303017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-token\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.303120 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.303059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-credential-socket\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.303120 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.303115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istiod-ca-cert\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.303343 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.303176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-podinfo\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.303343 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.303222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-envoy\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.404459 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.404419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-podinfo\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.404688 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.404502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-envoy\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.404688 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.404523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-socket\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.404688 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.404542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-data\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.404688 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.404558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlxlf\" (UniqueName: \"kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-kube-api-access-zlxlf\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.404688 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.404588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-certs\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.404688 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.404602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-token\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.404688 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.404630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-credential-socket\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.404688 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.404660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istiod-ca-cert\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.405137 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.405026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-socket\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.405137 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.405045    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-data\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.405244 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.405151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-credential-socket\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.405330 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.405312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-certs\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.405394 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.405375    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istiod-ca-cert\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.407544 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.407517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-envoy\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.407764 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.407745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-podinfo\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.415286 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.415263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-token\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.415937 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.415917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlxlf\" (UniqueName: \"kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-kube-api-access-zlxlf\") pod \"e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") " pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.535121 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.535029    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:55.678526 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.678497    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"]
Jul 13 19:01:55.680341 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:01:55.680306    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab019183_0890_4cd7_8dfa_bcf51e6c30bc.slice/crio-583fa9644cdb8fc474581655927906bf44ec8c41eb02ce51b06ad42942d5e11c WatchSource:0}: Error finding container 583fa9644cdb8fc474581655927906bf44ec8c41eb02ce51b06ad42942d5e11c: Status 404 returned error can't find the container with id 583fa9644cdb8fc474581655927906bf44ec8c41eb02ce51b06ad42942d5e11c
Jul 13 19:01:55.682884 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.682835    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:01:55.682997 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.682929    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:01:55.682997 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:55.682972    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:01:56.538666 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:56.538626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" event={"ID":"ab019183-0890-4cd7-8dfa-bcf51e6c30bc","Type":"ContainerStarted","Data":"91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291"}
Jul 13 19:01:56.539104 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:56.538689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" event={"ID":"ab019183-0890-4cd7-8dfa-bcf51e6c30bc","Type":"ContainerStarted","Data":"583fa9644cdb8fc474581655927906bf44ec8c41eb02ce51b06ad42942d5e11c"}
Jul 13 19:01:56.568208 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:56.568154    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" podStartSLOduration=1.5681324760000002 podStartE2EDuration="1.568132476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:01:56.566020798 +0000 UTC m=+1803.653126262" watchObservedRunningTime="2026-07-13 19:01:56.568132476 +0000 UTC m=+1803.655237942"
Jul 13 19:01:57.535760 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:57.535712    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:57.540963 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:57.540938    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:57.543726 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:57.543693    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:01:57.544574 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:01:57.544555    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:02:12.880940 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:12.880904    2565 patch_prober.go:28] interesting pod/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:40030->10.132.0.43:15021: read: connection reset by peer" start-of-body=
Jul 13 19:02:12.881311 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:12.880977    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:40030->10.132.0.43:15021: read: connection reset by peer"
Jul 13 19:02:13.627384 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:13.627348    2565 generic.go:356] "Generic (PLEG): container finished" podID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerID="91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291" exitCode=0
Jul 13 19:02:13.627574 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:13.627423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" event={"ID":"ab019183-0890-4cd7-8dfa-bcf51e6c30bc","Type":"ContainerDied","Data":"91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291"}
Jul 13 19:02:13.627902 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:13.627885    2565 scope.go:117] "RemoveContainer" containerID="91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291"
Jul 13 19:02:13.628928 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:13.628900    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:02:13.628986 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:13.628965    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:02:13.629030 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:13.628995    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:02:14.634482 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:14.634447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" event={"ID":"ab019183-0890-4cd7-8dfa-bcf51e6c30bc","Type":"ContainerStarted","Data":"55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc"}
Jul 13 19:02:15.535662 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:15.535620    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:02:15.535864 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:15.535839    2565 patch_prober.go:28] interesting pod/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 13 19:02:15.535913 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:15.535892    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 13 19:02:16.536370 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:16.536331    2565 patch_prober.go:28] interesting pod/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 13 19:02:16.536785 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:16.536418    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 13 19:02:17.535705 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:17.535661    2565 patch_prober.go:28] interesting pod/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 13 19:02:17.535956 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:17.535733    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 13 19:02:18.535843 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:18.535802    2565 patch_prober.go:28] interesting pod/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 13 19:02:18.536348 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:18.535886    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 13 19:02:19.539194 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:19.539164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:02:19.539603 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:19.539499    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:02:19.540307 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:19.540291    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:02:41.012637 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:02:41.012599    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"]
Jul 13 19:03:17.906135 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:17.906055    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"]
Jul 13 19:03:17.906611 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:17.906284    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy" containerID="cri-o://55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc" gracePeriod=30
Jul 13 19:03:19.541987 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:19.541942    2565 patch_prober.go:28] interesting pod/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 19:03:19.542378 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:19.542017    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:03:23.153640 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.153614    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:03:23.282710 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.282677    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlxlf\" (UniqueName: \"kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-kube-api-access-zlxlf\") pod \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") "
Jul 13 19:03:23.282710 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.282716    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-credential-socket\") pod \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") "
Jul 13 19:03:23.282957 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.282763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-envoy\") pod \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") "
Jul 13 19:03:23.282957 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.282810    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-data\") pod \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") "
Jul 13 19:03:23.282957 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.282835    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-token\") pod \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") "
Jul 13 19:03:23.283105 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.283019    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-podinfo\") pod \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") "
Jul 13 19:03:23.283105 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.283050    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-socket\") pod \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") "
Jul 13 19:03:23.283224 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.283115    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab019183-0890-4cd7-8dfa-bcf51e6c30bc" (UID: "ab019183-0890-4cd7-8dfa-bcf51e6c30bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:03:23.283224 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.283127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istiod-ca-cert\") pod \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") "
Jul 13 19:03:23.283224 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.283158    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-certs\") pod \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\" (UID: \"ab019183-0890-4cd7-8dfa-bcf51e6c30bc\") "
Jul 13 19:03:23.283651 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.283518    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab019183-0890-4cd7-8dfa-bcf51e6c30bc" (UID: "ab019183-0890-4cd7-8dfa-bcf51e6c30bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:03:23.283651 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.283540    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-credential-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:23.283651 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.283619    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab019183-0890-4cd7-8dfa-bcf51e6c30bc" (UID: "ab019183-0890-4cd7-8dfa-bcf51e6c30bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:03:23.283893 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.283775    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab019183-0890-4cd7-8dfa-bcf51e6c30bc" (UID: "ab019183-0890-4cd7-8dfa-bcf51e6c30bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:03:23.283992 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.283960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab019183-0890-4cd7-8dfa-bcf51e6c30bc" (UID: "ab019183-0890-4cd7-8dfa-bcf51e6c30bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:03:23.286437 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.286401    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab019183-0890-4cd7-8dfa-bcf51e6c30bc" (UID: "ab019183-0890-4cd7-8dfa-bcf51e6c30bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:03:23.286572 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.286514    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab019183-0890-4cd7-8dfa-bcf51e6c30bc" (UID: "ab019183-0890-4cd7-8dfa-bcf51e6c30bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:03:23.286572 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.286566    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab019183-0890-4cd7-8dfa-bcf51e6c30bc" (UID: "ab019183-0890-4cd7-8dfa-bcf51e6c30bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:03:23.286662 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.286614    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-kube-api-access-zlxlf" (OuterVolumeSpecName: "kube-api-access-zlxlf") pod "ab019183-0890-4cd7-8dfa-bcf51e6c30bc" (UID: "ab019183-0890-4cd7-8dfa-bcf51e6c30bc"). InnerVolumeSpecName "kube-api-access-zlxlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:03:23.384671 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.384630    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-podinfo\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:23.384671 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.384664    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:23.384881 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.384673    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istiod-ca-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:23.384881 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.384695    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-workload-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:23.384881 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.384703    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlxlf\" (UniqueName: \"kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-kube-api-access-zlxlf\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:23.384881 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.384712    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-envoy\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:23.384881 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.384722    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-data\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:23.384881 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.384729    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab019183-0890-4cd7-8dfa-bcf51e6c30bc-istio-token\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:23.862329 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.862228    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm"]
Jul 13 19:03:23.862617 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.862604    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy"
Jul 13 19:03:23.862617 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.862617    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy"
Jul 13 19:03:23.862762 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.862624    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy"
Jul 13 19:03:23.862762 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.862630    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy"
Jul 13 19:03:23.862762 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.862694    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy"
Jul 13 19:03:23.864913 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.864892    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm"
Jul 13 19:03:23.874071 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.873886    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm"]
Jul 13 19:03:23.957324 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.957287    2565 generic.go:356] "Generic (PLEG): container finished" podID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerID="55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc" exitCode=0
Jul 13 19:03:23.957545 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.957349    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"
Jul 13 19:03:23.957545 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.957370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" event={"ID":"ab019183-0890-4cd7-8dfa-bcf51e6c30bc","Type":"ContainerDied","Data":"55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc"}
Jul 13 19:03:23.957545 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.957424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr" event={"ID":"ab019183-0890-4cd7-8dfa-bcf51e6c30bc","Type":"ContainerDied","Data":"583fa9644cdb8fc474581655927906bf44ec8c41eb02ce51b06ad42942d5e11c"}
Jul 13 19:03:23.957545 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.957448    2565 scope.go:117] "RemoveContainer" containerID="55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc"
Jul 13 19:03:23.966383 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.966363    2565 scope.go:117] "RemoveContainer" containerID="91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291"
Jul 13 19:03:23.974590 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.974565    2565 scope.go:117] "RemoveContainer" containerID="55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc"
Jul 13 19:03:23.974877 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:03:23.974858    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc\": container with ID starting with 55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc not found: ID does not exist" containerID="55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc"
Jul 13 19:03:23.974940 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.974886    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc"} err="failed to get container status \"55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc\": rpc error: code = NotFound desc = could not find container \"55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc\": container with ID starting with 55fbbc3041675923e1e2475ea6bba26ad3a458d0db5785f14561c3f590861ecc not found: ID does not exist"
Jul 13 19:03:23.974940 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.974903    2565 scope.go:117] "RemoveContainer" containerID="91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291"
Jul 13 19:03:23.975166 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:03:23.975148    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291\": container with ID starting with 91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291 not found: ID does not exist" containerID="91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291"
Jul 13 19:03:23.975225 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.975171    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291"} err="failed to get container status \"91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291\": rpc error: code = NotFound desc = could not find container \"91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291\": container with ID starting with 91611f178e173aaa3a300ca992aefecddad04ea0e6ecdb66f9cf3f7de0ea8291 not found: ID does not exist"
Jul 13 19:03:23.976724 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.976702    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"]
Jul 13 19:03:23.980133 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.980112    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-258c642c-openshift-default-56ddd97cb9-744cr"]
Jul 13 19:03:23.989590 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:23.989570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/763bcc3b-724c-4e1c-b695-12dd2545482b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm\" (UID: \"763bcc3b-724c-4e1c-b695-12dd2545482b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm"
Jul 13 19:03:24.090727 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:24.090685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/763bcc3b-724c-4e1c-b695-12dd2545482b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm\" (UID: \"763bcc3b-724c-4e1c-b695-12dd2545482b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm"
Jul 13 19:03:24.091297 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:24.091277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/763bcc3b-724c-4e1c-b695-12dd2545482b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm\" (UID: \"763bcc3b-724c-4e1c-b695-12dd2545482b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm"
Jul 13 19:03:24.176786 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:24.176744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm"
Jul 13 19:03:24.316386 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:24.316353    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm"]
Jul 13 19:03:24.318805 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:03:24.318764    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763bcc3b_724c_4e1c_b695_12dd2545482b.slice/crio-2aac9eb852137c68db16900cdfecb0def6e9229b04952219e6c677b60b9fc6a0 WatchSource:0}: Error finding container 2aac9eb852137c68db16900cdfecb0def6e9229b04952219e6c677b60b9fc6a0: Status 404 returned error can't find the container with id 2aac9eb852137c68db16900cdfecb0def6e9229b04952219e6c677b60b9fc6a0
Jul 13 19:03:24.963293 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:24.963247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm" event={"ID":"763bcc3b-724c-4e1c-b695-12dd2545482b","Type":"ContainerStarted","Data":"2aac9eb852137c68db16900cdfecb0def6e9229b04952219e6c677b60b9fc6a0"}
Jul 13 19:03:25.466354 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:25.466320    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" path="/var/lib/kubelet/pods/ab019183-0890-4cd7-8dfa-bcf51e6c30bc/volumes"
Jul 13 19:03:27.982862 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:27.982822    2565 generic.go:356] "Generic (PLEG): container finished" podID="763bcc3b-724c-4e1c-b695-12dd2545482b" containerID="76fc23db83b2ef5ce75baaf133791f50ba3f79727c13ad8e4b1c0f7f7afb0653" exitCode=0
Jul 13 19:03:27.983222 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:27.982904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm" event={"ID":"763bcc3b-724c-4e1c-b695-12dd2545482b","Type":"ContainerDied","Data":"76fc23db83b2ef5ce75baaf133791f50ba3f79727c13ad8e4b1c0f7f7afb0653"}
Jul 13 19:03:29.115410 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:29.115386    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm"
Jul 13 19:03:29.236828 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:29.236796    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/763bcc3b-724c-4e1c-b695-12dd2545482b-maas-api-service-ca\") pod \"763bcc3b-724c-4e1c-b695-12dd2545482b\" (UID: \"763bcc3b-724c-4e1c-b695-12dd2545482b\") "
Jul 13 19:03:29.237216 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:29.237193    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/763bcc3b-724c-4e1c-b695-12dd2545482b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "763bcc3b-724c-4e1c-b695-12dd2545482b" (UID: "763bcc3b-724c-4e1c-b695-12dd2545482b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:03:29.338162 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:29.338073    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/763bcc3b-724c-4e1c-b695-12dd2545482b-maas-api-service-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:29.993395 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:29.993368    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm"
Jul 13 19:03:29.993583 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:29.993364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm" event={"ID":"763bcc3b-724c-4e1c-b695-12dd2545482b","Type":"ContainerDied","Data":"2aac9eb852137c68db16900cdfecb0def6e9229b04952219e6c677b60b9fc6a0"}
Jul 13 19:03:29.993583 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:29.993510    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2aac9eb852137c68db16900cdfecb0def6e9229b04952219e6c677b60b9fc6a0"
Jul 13 19:03:43.195101 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:03:43.195047    2565 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading signatures: reading signature from https://registry.redhat.io/containers/sigstore/ubi9/ubi-minimal@sha256=b966f21589d418d1e02159cb8e03e261fc8c4ee9061258893f5e4e33986aac4c/signature-13: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image" image="registry.redhat.io/ubi9/ubi-minimal:9.7"
Jul 13 19:03:43.195565 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:03:43.195233    2565 kuberuntime_manager.go:1459] "Unhandled Error" err="container revoke-keys start failed in pod maas-api-revoke-keys-e2e-migrate-78327326-bmq96_odh-ai-gateway-infra(e8aa353d-056b-4d96-8932-2e0f91d1ce15): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading signatures: reading signature from https://registry.redhat.io/containers/sigstore/ubi9/ubi-minimal@sha256=b966f21589d418d1e02159cb8e03e261fc8c4ee9061258893f5e4e33986aac4c/signature-13: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 13 19:03:43.195565 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:03:43.195283    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading signatures: reading signature from https://registry.redhat.io/containers/sigstore/ubi9/ubi-minimal@sha256=b966f21589d418d1e02159cb8e03e261fc8c4ee9061258893f5e4e33986aac4c/signature-13: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96" podUID="e8aa353d-056b-4d96-8932-2e0f91d1ce15"
Jul 13 19:03:44.197480 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:44.197436    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"
Jul 13 19:03:44.266845 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:44.266797    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8aa353d-056b-4d96-8932-2e0f91d1ce15-maas-api-service-ca\") pod \"e8aa353d-056b-4d96-8932-2e0f91d1ce15\" (UID: \"e8aa353d-056b-4d96-8932-2e0f91d1ce15\") "
Jul 13 19:03:44.267204 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:44.267181    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8aa353d-056b-4d96-8932-2e0f91d1ce15-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e8aa353d-056b-4d96-8932-2e0f91d1ce15" (UID: "e8aa353d-056b-4d96-8932-2e0f91d1ce15"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:03:44.368119 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:44.368000    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8aa353d-056b-4d96-8932-2e0f91d1ce15-maas-api-service-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:03:45.065710 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:45.065679    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"
Jul 13 19:03:45.065710 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:45.065690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96" event={"ID":"e8aa353d-056b-4d96-8932-2e0f91d1ce15","Type":"ContainerDied","Data":"f99c45ab81cffc1d480bed48319fc78543cc46aeca654641adc5f35581c50a09"}
Jul 13 19:03:45.104156 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:45.104121    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"]
Jul 13 19:03:45.108277 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:45.108248    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-bmq96"]
Jul 13 19:03:45.465957 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:03:45.465924    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8aa353d-056b-4d96-8932-2e0f91d1ce15" path="/var/lib/kubelet/pods/e8aa353d-056b-4d96-8932-2e0f91d1ce15/volumes"
Jul 13 19:05:27.467146 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.467112    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"]
Jul 13 19:05:27.467633 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.467613    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763bcc3b-724c-4e1c-b695-12dd2545482b" containerName="revoke-keys"
Jul 13 19:05:27.467633 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.467628    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="763bcc3b-724c-4e1c-b695-12dd2545482b" containerName="revoke-keys"
Jul 13 19:05:27.467718 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.467711    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab019183-0890-4cd7-8dfa-bcf51e6c30bc" containerName="istio-proxy"
Jul 13 19:05:27.467761 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.467721    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="763bcc3b-724c-4e1c-b695-12dd2545482b" containerName="revoke-keys"
Jul 13 19:05:27.470808 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.470791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.473328 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.473306    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7577a6d1-openshift-default-dockercfg-t442c\""
Jul 13 19:05:27.483352 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.483330    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"]
Jul 13 19:05:27.551876 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.551834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-envoy\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.551876 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.551879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-credential-socket\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.552171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.551902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-token\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.552171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.551927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-data\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.552171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.551972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istiod-ca-cert\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.552171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.552038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj7gk\" (UniqueName: \"kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-kube-api-access-kj7gk\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.552171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.552117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-socket\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.552171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.552155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-certs\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.552384 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.552173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-podinfo\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.652639 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.652603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-socket\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.652639 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.652643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-certs\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.652874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.652662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-podinfo\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.652874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.652704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-envoy\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.652874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.652727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-credential-socket\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.652874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.652749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-token\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.652874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.652778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-data\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.652874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.652823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istiod-ca-cert\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.653575 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.652931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj7gk\" (UniqueName: \"kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-kube-api-access-kj7gk\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.653575 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.653075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-certs\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.653575 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.653124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-socket\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.653575 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.653543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-data\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.653742 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.653719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-credential-socket\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.654084 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.654065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istiod-ca-cert\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.655320 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.655298    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-envoy\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.655422 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.655332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-podinfo\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.661265 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.661237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj7gk\" (UniqueName: \"kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-kube-api-access-kj7gk\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.661906 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.661883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-token\") pod \"e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") " pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.783141 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.783032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:27.930738 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.930710    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"]
Jul 13 19:05:27.932847 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:05:27.932820    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5d88e9_7c0d_43b0_9d9c_791a6e11c241.slice/crio-da2f822b8ffc99b7814de12d4622bd503f5c696cf9de84097044f052b128b80c WatchSource:0}: Error finding container da2f822b8ffc99b7814de12d4622bd503f5c696cf9de84097044f052b128b80c: Status 404 returned error can't find the container with id da2f822b8ffc99b7814de12d4622bd503f5c696cf9de84097044f052b128b80c
Jul 13 19:05:27.935181 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.935147    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:05:27.935272 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.935256    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:05:27.935310 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:27.935299    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:05:28.550170 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:28.550136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" event={"ID":"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241","Type":"ContainerStarted","Data":"e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26"}
Jul 13 19:05:28.550577 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:28.550202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" event={"ID":"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241","Type":"ContainerStarted","Data":"da2f822b8ffc99b7814de12d4622bd503f5c696cf9de84097044f052b128b80c"}
Jul 13 19:05:28.573144 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:28.573006    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" podStartSLOduration=1.5729881730000002 podStartE2EDuration="1.572988173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:05:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:05:28.572369035 +0000 UTC m=+2015.659474500" watchObservedRunningTime="2026-07-13 19:05:28.572988173 +0000 UTC m=+2015.660093638"
Jul 13 19:05:28.783396 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:28.783358    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:29.788684 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:29.788651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:30.559391 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:30.559356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:30.560428 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:30.560408    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:43.629735 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:43.629653    2565 generic.go:356] "Generic (PLEG): container finished" podID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerID="e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26" exitCode=0
Jul 13 19:05:43.630438 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:43.629741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" event={"ID":"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241","Type":"ContainerDied","Data":"e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26"}
Jul 13 19:05:43.630438 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:43.630257    2565 scope.go:117] "RemoveContainer" containerID="e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26"
Jul 13 19:05:43.631635 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:43.631608    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:05:43.631722 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:43.631692    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:05:43.631778 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:43.631753    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:05:44.636513 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:44.636456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" event={"ID":"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241","Type":"ContainerStarted","Data":"9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2"}
Jul 13 19:05:44.784140 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:44.784088    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:44.785802 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:44.785457    2565 patch_prober.go:28] interesting pod/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 13 19:05:44.785802 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:44.785535    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 13 19:05:45.560170 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:45.560132    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:45.784359 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:45.784314    2565 patch_prober.go:28] interesting pod/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 13 19:05:45.784869 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:45.784386    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 13 19:05:46.783851 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:46.783803    2565 patch_prober.go:28] interesting pod/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 13 19:05:46.784074 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:46.783894    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 13 19:05:47.783814 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:47.783778    2565 patch_prober.go:28] interesting pod/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 13 19:05:47.784377 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:47.784350    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 13 19:05:48.787968 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:48.787938    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:05:48.788904 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:05:48.788884    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:06:08.692562 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:08.692528    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"]
Jul 13 19:06:08.693108 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:08.692746    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy" containerID="cri-o://9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2" gracePeriod=30
Jul 13 19:06:13.946656 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:13.946627    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:06:14.071682 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.071596    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj7gk\" (UniqueName: \"kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-kube-api-access-kj7gk\") pod \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") "
Jul 13 19:06:14.071682 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.071638    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-credential-socket\") pod \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") "
Jul 13 19:06:14.071682 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.071674    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istiod-ca-cert\") pod \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") "
Jul 13 19:06:14.071973 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.071695    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-envoy\") pod \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") "
Jul 13 19:06:14.071973 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.071713    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-socket\") pod \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") "
Jul 13 19:06:14.071973 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.071748    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-podinfo\") pod \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") "
Jul 13 19:06:14.071973 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.071776    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-token\") pod \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") "
Jul 13 19:06:14.071973 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.071806    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-certs\") pod \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") "
Jul 13 19:06:14.071973 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.071837    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-data\") pod \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\" (UID: \"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241\") "
Jul 13 19:06:14.072276 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.072053    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" (UID: "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:06:14.072276 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.072153    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" (UID: "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:06:14.072276 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.072253    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" (UID: "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:06:14.072431 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.072306    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" (UID: "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:06:14.073056 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.073028    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" (UID: "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:06:14.074223 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.074197    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" (UID: "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:06:14.074343 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.074218    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" (UID: "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:06:14.074550 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.074533    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" (UID: "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:06:14.074620 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.074554    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-kube-api-access-kj7gk" (OuterVolumeSpecName: "kube-api-access-kj7gk") pod "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" (UID: "8c5d88e9-7c0d-43b0-9d9c-791a6e11c241"). InnerVolumeSpecName "kube-api-access-kj7gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:06:14.173247 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.173216    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:06:14.173247 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.173242    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-data\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:06:14.173247 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.173251    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj7gk\" (UniqueName: \"kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-kube-api-access-kj7gk\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:06:14.173566 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.173260    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-credential-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:06:14.173566 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.173270    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istiod-ca-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:06:14.173566 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.173279    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-envoy\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:06:14.173566 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.173287    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-workload-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:06:14.173566 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.173295    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-podinfo\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:06:14.173566 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.173302    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241-istio-token\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:06:14.773734 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.773656    2565 generic.go:356] "Generic (PLEG): container finished" podID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerID="9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2" exitCode=0
Jul 13 19:06:14.773734 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.773705    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"
Jul 13 19:06:14.773920 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.773735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" event={"ID":"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241","Type":"ContainerDied","Data":"9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2"}
Jul 13 19:06:14.773920 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.773790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl" event={"ID":"8c5d88e9-7c0d-43b0-9d9c-791a6e11c241","Type":"ContainerDied","Data":"da2f822b8ffc99b7814de12d4622bd503f5c696cf9de84097044f052b128b80c"}
Jul 13 19:06:14.773920 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.773812    2565 scope.go:117] "RemoveContainer" containerID="9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2"
Jul 13 19:06:14.783090 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.783072    2565 scope.go:117] "RemoveContainer" containerID="e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26"
Jul 13 19:06:14.790757 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.790737    2565 scope.go:117] "RemoveContainer" containerID="9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2"
Jul 13 19:06:14.791024 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:06:14.790999    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2\": container with ID starting with 9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2 not found: ID does not exist" containerID="9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2"
Jul 13 19:06:14.791083 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.791032    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2"} err="failed to get container status \"9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2\": rpc error: code = NotFound desc = could not find container \"9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2\": container with ID starting with 9c8ecd70d166137c0cd831148ab5ecbdb4cbefc73748d8ef36ccf855337a84b2 not found: ID does not exist"
Jul 13 19:06:14.791083 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.791052    2565 scope.go:117] "RemoveContainer" containerID="e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26"
Jul 13 19:06:14.791288 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:06:14.791270    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26\": container with ID starting with e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26 not found: ID does not exist" containerID="e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26"
Jul 13 19:06:14.791325 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.791296    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26"} err="failed to get container status \"e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26\": rpc error: code = NotFound desc = could not find container \"e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26\": container with ID starting with e772c3ec385c9a5ca3f6eb2cde1b101b96c0dcb2a8981e9ff7234c8506146f26 not found: ID does not exist"
Jul 13 19:06:14.795588 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.795568    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"]
Jul 13 19:06:14.799366 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:14.799346    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7577a6d1-openshift-default-85cfcf477f-vldsl"]
Jul 13 19:06:15.464862 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:15.464819    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" path="/var/lib/kubelet/pods/8c5d88e9-7c0d-43b0-9d9c-791a6e11c241/volumes"
Jul 13 19:06:28.541821 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.541783    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"]
Jul 13 19:06:28.542177 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.542121    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy"
Jul 13 19:06:28.542177 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.542133    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy"
Jul 13 19:06:28.542177 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.542142    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy"
Jul 13 19:06:28.542177 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.542147    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy"
Jul 13 19:06:28.542318 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.542214    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy"
Jul 13 19:06:28.542318 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.542223    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c5d88e9-7c0d-43b0-9d9c-791a6e11c241" containerName="istio-proxy"
Jul 13 19:06:28.544332 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.544310    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.547095 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.547068    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-991a1835-openshift-default-dockercfg-b6q66\""
Jul 13 19:06:28.557540 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.557515    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"]
Jul 13 19:06:28.704151 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.704115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d43a934a-d9f6-483e-9545-60958f2989c7-istiod-ca-cert\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.704365 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.704164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-credential-socket\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.704365 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.704205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwjq2\" (UniqueName: \"kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-kube-api-access-nwjq2\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.704365 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.704243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-socket\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.704365 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.704272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d43a934a-d9f6-483e-9545-60958f2989c7-istio-podinfo\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.704365 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.704307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-istio-token\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.704365 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.704324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-data\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.704365 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.704345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-certs\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.704756 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.704368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-envoy\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805200 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-credential-socket\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805200 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwjq2\" (UniqueName: \"kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-kube-api-access-nwjq2\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805415 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-socket\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805415 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d43a934a-d9f6-483e-9545-60958f2989c7-istio-podinfo\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805415 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-istio-token\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805415 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-data\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805671 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-certs\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805671 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805457    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-envoy\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805671 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d43a934a-d9f6-483e-9545-60958f2989c7-istiod-ca-cert\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805829 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-credential-socket\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805829 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-certs\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805914 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-data\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.805952 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.805936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-socket\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.806153 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.806137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d43a934a-d9f6-483e-9545-60958f2989c7-istiod-ca-cert\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.807848 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.807820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-envoy\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.807979 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.807962    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d43a934a-d9f6-483e-9545-60958f2989c7-istio-podinfo\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.816228 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.816194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwjq2\" (UniqueName: \"kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-kube-api-access-nwjq2\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.816352 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.816337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-istio-token\") pod \"e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") " pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.854438 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.854411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:28.993522 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.993497    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"]
Jul 13 19:06:28.995247 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:06:28.995221    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43a934a_d9f6_483e_9545_60958f2989c7.slice/crio-6688b25979480cca64bbdd79d242db4144fe8431d03fdf3b6eb8c3e818b4ed6a WatchSource:0}: Error finding container 6688b25979480cca64bbdd79d242db4144fe8431d03fdf3b6eb8c3e818b4ed6a: Status 404 returned error can't find the container with id 6688b25979480cca64bbdd79d242db4144fe8431d03fdf3b6eb8c3e818b4ed6a
Jul 13 19:06:28.997240 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.997208    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:06:28.997316 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.997279    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:06:28.997316 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:28.997308    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:06:29.846938 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:29.846897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" event={"ID":"d43a934a-d9f6-483e-9545-60958f2989c7","Type":"ContainerStarted","Data":"93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74"}
Jul 13 19:06:29.847322 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:29.846963    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" event={"ID":"d43a934a-d9f6-483e-9545-60958f2989c7","Type":"ContainerStarted","Data":"6688b25979480cca64bbdd79d242db4144fe8431d03fdf3b6eb8c3e818b4ed6a"}
Jul 13 19:06:29.855387 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:29.855362    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:29.869945 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:29.869892    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" podStartSLOduration=1.8698734099999998 podStartE2EDuration="1.86987341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:06:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:06:29.868549934 +0000 UTC m=+2076.955655419" watchObservedRunningTime="2026-07-13 19:06:29.86987341 +0000 UTC m=+2076.956978876"
Jul 13 19:06:30.860313 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:30.860282    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:31.857381 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:31.857348    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:31.858422 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:31.858403    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:44.927366 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:44.927333    2565 generic.go:356] "Generic (PLEG): container finished" podID="d43a934a-d9f6-483e-9545-60958f2989c7" containerID="93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74" exitCode=0
Jul 13 19:06:44.927821 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:44.927408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" event={"ID":"d43a934a-d9f6-483e-9545-60958f2989c7","Type":"ContainerDied","Data":"93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74"}
Jul 13 19:06:44.927870 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:44.927839    2565 scope.go:117] "RemoveContainer" containerID="93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74"
Jul 13 19:06:44.928867 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:44.928834    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:06:44.928981 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:44.928922    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:06:44.928981 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:44.928971    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:06:45.933972 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:45.933939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" event={"ID":"d43a934a-d9f6-483e-9545-60958f2989c7","Type":"ContainerStarted","Data":"d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881"}
Jul 13 19:06:46.855093 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:46.855058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:46.856246 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:46.856214    2565 patch_prober.go:28] interesting pod/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 13 19:06:46.856362 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:46.856268    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 13 19:06:46.857292 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:46.857272    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:47.855769 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:47.855717    2565 patch_prober.go:28] interesting pod/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 13 19:06:47.856252 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:47.855790    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 13 19:06:48.854905 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:48.854869    2565 patch_prober.go:28] interesting pod/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 13 19:06:48.855078 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:48.854925    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 13 19:06:49.859262 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:49.859182    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:49.860194 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:49.860174    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:06:53.458053 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:53.458013    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 19:06:53.463832 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:53.463807    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 19:06:53.465749 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:53.465727    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 19:06:53.470758 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:06:53.470739    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 19:08:32.465322 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:32.465285    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"]
Jul 13 19:08:32.465916 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:32.465580    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy" containerID="cri-o://d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881" gracePeriod=30
Jul 13 19:08:34.862418 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:34.862374    2565 patch_prober.go:28] interesting pod/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 19:08:34.862798 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:34.862453    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:08:37.731073 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.731048    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:08:37.762267 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762238    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-socket\") pod \"d43a934a-d9f6-483e-9545-60958f2989c7\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") "
Jul 13 19:08:37.762447 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762290    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d43a934a-d9f6-483e-9545-60958f2989c7-istiod-ca-cert\") pod \"d43a934a-d9f6-483e-9545-60958f2989c7\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") "
Jul 13 19:08:37.762447 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762317    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-data\") pod \"d43a934a-d9f6-483e-9545-60958f2989c7\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") "
Jul 13 19:08:37.762447 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762359    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-certs\") pod \"d43a934a-d9f6-483e-9545-60958f2989c7\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") "
Jul 13 19:08:37.762447 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762405    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-istio-token\") pod \"d43a934a-d9f6-483e-9545-60958f2989c7\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") "
Jul 13 19:08:37.762447 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762435    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwjq2\" (UniqueName: \"kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-kube-api-access-nwjq2\") pod \"d43a934a-d9f6-483e-9545-60958f2989c7\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") "
Jul 13 19:08:37.762753 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762465    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d43a934a-d9f6-483e-9545-60958f2989c7-istio-podinfo\") pod \"d43a934a-d9f6-483e-9545-60958f2989c7\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") "
Jul 13 19:08:37.762753 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762548    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-envoy\") pod \"d43a934a-d9f6-483e-9545-60958f2989c7\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") "
Jul 13 19:08:37.762753 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762576    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-credential-socket\") pod \"d43a934a-d9f6-483e-9545-60958f2989c7\" (UID: \"d43a934a-d9f6-483e-9545-60958f2989c7\") "
Jul 13 19:08:37.762904 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762567    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d43a934a-d9f6-483e-9545-60958f2989c7" (UID: "d43a934a-d9f6-483e-9545-60958f2989c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:08:37.762904 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d43a934a-d9f6-483e-9545-60958f2989c7" (UID: "d43a934a-d9f6-483e-9545-60958f2989c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:08:37.762904 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762790    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d43a934a-d9f6-483e-9545-60958f2989c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d43a934a-d9f6-483e-9545-60958f2989c7" (UID: "d43a934a-d9f6-483e-9545-60958f2989c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:08:37.763027 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.762918    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d43a934a-d9f6-483e-9545-60958f2989c7" (UID: "d43a934a-d9f6-483e-9545-60958f2989c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:08:37.763335 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.763306    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "d43a934a-d9f6-483e-9545-60958f2989c7" (UID: "d43a934a-d9f6-483e-9545-60958f2989c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:08:37.765171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.765133    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d43a934a-d9f6-483e-9545-60958f2989c7" (UID: "d43a934a-d9f6-483e-9545-60958f2989c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:08:37.765171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.765137    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-kube-api-access-nwjq2" (OuterVolumeSpecName: "kube-api-access-nwjq2") pod "d43a934a-d9f6-483e-9545-60958f2989c7" (UID: "d43a934a-d9f6-483e-9545-60958f2989c7"). InnerVolumeSpecName "kube-api-access-nwjq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:08:37.765337 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.765304    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d43a934a-d9f6-483e-9545-60958f2989c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d43a934a-d9f6-483e-9545-60958f2989c7" (UID: "d43a934a-d9f6-483e-9545-60958f2989c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:08:37.765408 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.765386    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "d43a934a-d9f6-483e-9545-60958f2989c7" (UID: "d43a934a-d9f6-483e-9545-60958f2989c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:08:37.863668 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.863621    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:08:37.863668 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.863660    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-istio-token\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:08:37.863668 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.863669    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwjq2\" (UniqueName: \"kubernetes.io/projected/d43a934a-d9f6-483e-9545-60958f2989c7-kube-api-access-nwjq2\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:08:37.863668 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.863680    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d43a934a-d9f6-483e-9545-60958f2989c7-istio-podinfo\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:08:37.863955 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.863688    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-envoy\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:08:37.863955 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.863697    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-credential-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:08:37.863955 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.863705    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-workload-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:08:37.863955 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.863713    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d43a934a-d9f6-483e-9545-60958f2989c7-istiod-ca-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:08:37.863955 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:37.863721    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d43a934a-d9f6-483e-9545-60958f2989c7-istio-data\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:08:38.471052 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.471014    2565 generic.go:356] "Generic (PLEG): container finished" podID="d43a934a-d9f6-483e-9545-60958f2989c7" containerID="d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881" exitCode=0
Jul 13 19:08:38.471307 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.471070    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"
Jul 13 19:08:38.471307 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.471097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" event={"ID":"d43a934a-d9f6-483e-9545-60958f2989c7","Type":"ContainerDied","Data":"d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881"}
Jul 13 19:08:38.471307 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.471154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww" event={"ID":"d43a934a-d9f6-483e-9545-60958f2989c7","Type":"ContainerDied","Data":"6688b25979480cca64bbdd79d242db4144fe8431d03fdf3b6eb8c3e818b4ed6a"}
Jul 13 19:08:38.471307 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.471168    2565 scope.go:117] "RemoveContainer" containerID="d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881"
Jul 13 19:08:38.480921 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.480901    2565 scope.go:117] "RemoveContainer" containerID="93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74"
Jul 13 19:08:38.488651 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.488632    2565 scope.go:117] "RemoveContainer" containerID="d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881"
Jul 13 19:08:38.488898 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:08:38.488875    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881\": container with ID starting with d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881 not found: ID does not exist" containerID="d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881"
Jul 13 19:08:38.489015 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.488905    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881"} err="failed to get container status \"d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881\": rpc error: code = NotFound desc = could not find container \"d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881\": container with ID starting with d16bdc210929998dd180dec166ebfce5fd8b7657eaff6fd21f69aa3d244c0881 not found: ID does not exist"
Jul 13 19:08:38.489015 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.488923    2565 scope.go:117] "RemoveContainer" containerID="93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74"
Jul 13 19:08:38.489175 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:08:38.489156    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74\": container with ID starting with 93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74 not found: ID does not exist" containerID="93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74"
Jul 13 19:08:38.489234 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.489183    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74"} err="failed to get container status \"93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74\": rpc error: code = NotFound desc = could not find container \"93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74\": container with ID starting with 93de5b55f11edaaaf88794760a25e8fe669b4f3490cfaac1ce8817a99d3abb74 not found: ID does not exist"
Jul 13 19:08:38.494067 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.494042    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"]
Jul 13 19:08:38.498415 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:38.498389    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-991a1835-openshift-default-fb88b9f7f-dmzww"]
Jul 13 19:08:39.465869 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:08:39.465836    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" path="/var/lib/kubelet/pods/d43a934a-d9f6-483e-9545-60958f2989c7/volumes"
Jul 13 19:09:28.747891 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.747773    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"]
Jul 13 19:09:28.748456 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.748276    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy"
Jul 13 19:09:28.748456 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.748296    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy"
Jul 13 19:09:28.748456 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.748338    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy"
Jul 13 19:09:28.748456 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.748347    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy"
Jul 13 19:09:28.748456 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.748434    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy"
Jul 13 19:09:28.748456 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.748447    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d43a934a-d9f6-483e-9545-60958f2989c7" containerName="istio-proxy"
Jul 13 19:09:28.751552 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.751506    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.754688 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.754668    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5d44da-openshift-default-dockercfg-b66wj\""
Jul 13 19:09:28.771376 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.771346    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"]
Jul 13 19:09:28.812877 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.812836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-credential-socket\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.813062 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.812943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-socket\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.813062 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.812971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-data\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.813062 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.812992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-token\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.813062 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.813034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-certs\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.813062 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.813051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-envoy\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.813252 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.813073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-podinfo\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.813252 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.813125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4n47\" (UniqueName: \"kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-kube-api-access-x4n47\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.813252 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.813152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f211245f-6d05-4b30-8bbf-0948f9119e67-istiod-ca-cert\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.913647 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.913606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-socket\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.913647 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.913650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-data\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.913906 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.913675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-token\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.913906 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.913792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-certs\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.913906 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.913823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-envoy\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.913906 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.913842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-podinfo\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.913906 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.913884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4n47\" (UniqueName: \"kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-kube-api-access-x4n47\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.914171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.913918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f211245f-6d05-4b30-8bbf-0948f9119e67-istiod-ca-cert\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.914171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.913962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-credential-socket\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.914171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.914093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-socket\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.914374 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.914355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-data\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.914618 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.914591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-credential-socket\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.914618 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.914605    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-certs\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.914805 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.914781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f211245f-6d05-4b30-8bbf-0948f9119e67-istiod-ca-cert\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.916393 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.916368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-envoy\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.916600 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.916577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-podinfo\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.922740 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.922715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-token\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:28.922875 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:28.922855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4n47\" (UniqueName: \"kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-kube-api-access-x4n47\") pod \"e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") " pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:29.063984 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:29.063897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:29.212462 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:29.212425    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"]
Jul 13 19:09:29.216238 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:09:29.216204    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf211245f_6d05_4b30_8bbf_0948f9119e67.slice/crio-c911eb82428c77fcb19b5cd76b013600b991a9fece82420df9ed02baa977c37d WatchSource:0}: Error finding container c911eb82428c77fcb19b5cd76b013600b991a9fece82420df9ed02baa977c37d: Status 404 returned error can't find the container with id c911eb82428c77fcb19b5cd76b013600b991a9fece82420df9ed02baa977c37d
Jul 13 19:09:29.218227 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:29.218192    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:29.218332 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:29.218273    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:29.218332 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:29.218319    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:29.712775 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:29.712736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" event={"ID":"f211245f-6d05-4b30-8bbf-0948f9119e67","Type":"ContainerStarted","Data":"bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4"}
Jul 13 19:09:29.712958 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:29.712815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" event={"ID":"f211245f-6d05-4b30-8bbf-0948f9119e67","Type":"ContainerStarted","Data":"c911eb82428c77fcb19b5cd76b013600b991a9fece82420df9ed02baa977c37d"}
Jul 13 19:09:29.772708 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:29.772648    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" podStartSLOduration=1.772632432 podStartE2EDuration="1.772632432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:09:29.770134381 +0000 UTC m=+2256.857239862" watchObservedRunningTime="2026-07-13 19:09:29.772632432 +0000 UTC m=+2256.859737938"
Jul 13 19:09:30.064235 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:30.064116    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:30.069630 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:30.069604    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:30.720001 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:30.719971    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:30.721009 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:30.720986    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:36.942853 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.942816    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"]
Jul 13 19:09:36.946938 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.946917    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:36.949857 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.949837    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0a46d9-openshift-default-dockercfg-bkqcq\""
Jul 13 19:09:36.960314 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.960289    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"]
Jul 13 19:09:36.982611 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.982581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-istio-token\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:36.982741 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.982700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-socket\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:36.982741 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.982724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-certs\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:36.982828 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.982760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh9tb\" (UniqueName: \"kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-kube-api-access-dh9tb\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:36.982828 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.982797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-envoy\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:36.982828 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.982814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-data\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:36.982982 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.982827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80426357-1d74-4746-ba9e-6491e53eafe7-istio-podinfo\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:36.982982 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.982848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80426357-1d74-4746-ba9e-6491e53eafe7-istiod-ca-cert\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:36.982982 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:36.982895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-credential-socket\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.083712 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.083673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-socket\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.083712 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.083712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-certs\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.083984 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.083750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh9tb\" (UniqueName: \"kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-kube-api-access-dh9tb\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.083984 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.083800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-envoy\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.083984 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.083828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-data\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.083984 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.083850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80426357-1d74-4746-ba9e-6491e53eafe7-istio-podinfo\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.084196 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.084164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-certs\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.084271 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.084239    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-socket\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.084330 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.084273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-data\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.084330 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.084300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80426357-1d74-4746-ba9e-6491e53eafe7-istiod-ca-cert\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.084435 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.084349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-credential-socket\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.084435 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.084394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-istio-token\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.085234 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.085207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80426357-1d74-4746-ba9e-6491e53eafe7-istiod-ca-cert\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.085428 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.085408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-credential-socket\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.086714 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.086691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-envoy\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.086831 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.086789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80426357-1d74-4746-ba9e-6491e53eafe7-istio-podinfo\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.093413 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.093387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-istio-token\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.093861 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.093844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh9tb\" (UniqueName: \"kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-kube-api-access-dh9tb\") pod \"e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") " pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.257540 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.257433    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:37.414576 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.414543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"]
Jul 13 19:09:37.418149 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:09:37.418121    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80426357_1d74_4746_ba9e_6491e53eafe7.slice/crio-9bf0fbc27d46522dfd88892466992ec8cbf5d06e8a2e5b7976afbe5b59750055 WatchSource:0}: Error finding container 9bf0fbc27d46522dfd88892466992ec8cbf5d06e8a2e5b7976afbe5b59750055: Status 404 returned error can't find the container with id 9bf0fbc27d46522dfd88892466992ec8cbf5d06e8a2e5b7976afbe5b59750055
Jul 13 19:09:37.420870 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.420824    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:37.420949 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.420916    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:37.420986 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.420953    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:37.761386 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.761351    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" event={"ID":"80426357-1d74-4746-ba9e-6491e53eafe7","Type":"ContainerStarted","Data":"5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb"}
Jul 13 19:09:37.761619 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.761401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" event={"ID":"80426357-1d74-4746-ba9e-6491e53eafe7","Type":"ContainerStarted","Data":"9bf0fbc27d46522dfd88892466992ec8cbf5d06e8a2e5b7976afbe5b59750055"}
Jul 13 19:09:37.803918 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:37.803867    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" podStartSLOduration=1.803851727 podStartE2EDuration="1.803851727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:09:37.8014463 +0000 UTC m=+2264.888551764" watchObservedRunningTime="2026-07-13 19:09:37.803851727 +0000 UTC m=+2264.890957191"
Jul 13 19:09:38.257945 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:38.257910    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:38.262659 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:38.262635    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:38.766395 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:38.766366    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:38.767449 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:38.767428    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:46.761617 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:46.761579    2565 patch_prober.go:28] interesting pod/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 19:09:46.761989 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:46.761634    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 19:09:47.821787 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:47.821684    2565 generic.go:356] "Generic (PLEG): container finished" podID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerID="bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4" exitCode=0
Jul 13 19:09:47.821787 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:47.821748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" event={"ID":"f211245f-6d05-4b30-8bbf-0948f9119e67","Type":"ContainerDied","Data":"bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4"}
Jul 13 19:09:47.822217 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:47.822116    2565 scope.go:117] "RemoveContainer" containerID="bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4"
Jul 13 19:09:47.823238 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:47.823200    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:47.823309 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:47.823269    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:47.823347 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:47.823307    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:48.828309 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:48.828267    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" event={"ID":"f211245f-6d05-4b30-8bbf-0948f9119e67","Type":"ContainerStarted","Data":"1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4"}
Jul 13 19:09:49.064512 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:49.064446    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:49.064725 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:49.064699    2565 patch_prober.go:28] interesting pod/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 13 19:09:49.064771 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:49.064755    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 13 19:09:50.064976 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:50.064933    2565 patch_prober.go:28] interesting pod/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 13 19:09:50.065448 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:50.064998    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 13 19:09:51.065229 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:51.065184    2565 patch_prober.go:28] interesting pod/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 13 19:09:51.065664 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:51.065240    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 13 19:09:52.064576 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:52.064530    2565 patch_prober.go:28] interesting pod/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 13 19:09:52.064785 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:52.064594    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 13 19:09:53.067966 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:53.067932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:53.068372 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:53.068222    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:53.069033 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:53.069004    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:09:54.807728 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:54.807675    2565 patch_prober.go:28] interesting pod/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 19:09:54.808134 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:54.807778    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 19:09:56.869555 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:56.869435    2565 generic.go:356] "Generic (PLEG): container finished" podID="80426357-1d74-4746-ba9e-6491e53eafe7" containerID="5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb" exitCode=0
Jul 13 19:09:56.869555 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:56.869522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" event={"ID":"80426357-1d74-4746-ba9e-6491e53eafe7","Type":"ContainerDied","Data":"5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb"}
Jul 13 19:09:56.869976 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:56.869909    2565 scope.go:117] "RemoveContainer" containerID="5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb"
Jul 13 19:09:56.870976 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:56.870950    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:56.871048 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:56.871024    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:56.871083 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:56.871055    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:09:57.878077 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:57.878032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" event={"ID":"80426357-1d74-4746-ba9e-6491e53eafe7","Type":"ContainerStarted","Data":"5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e"}
Jul 13 19:09:58.257811 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:58.257765    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:09:58.258061 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:58.258036    2565 patch_prober.go:28] interesting pod/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 13 19:09:58.258144 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:58.258093    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 13 19:09:59.258812 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:59.258775    2565 patch_prober.go:28] interesting pod/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 13 19:09:59.259224 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:09:59.258831    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 13 19:10:00.258094 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:00.258055    2565 patch_prober.go:28] interesting pod/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 13 19:10:00.258351 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:00.258115    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 13 19:10:01.258155 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:01.258120    2565 patch_prober.go:28] interesting pod/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 13 19:10:01.258594 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:01.258176    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 13 19:10:02.261071 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:02.261039    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:10:02.261520 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:02.261322    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:10:02.262114 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:02.262099    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:10:10.588198 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.588165    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"]
Jul 13 19:10:10.591695 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.591677    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.596084 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.596064    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0a46d9\"/\"test-model-0a46d9-kserve-self-signed-certs\""
Jul 13 19:10:10.596640 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.596623    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0a46d9\"/\"default-dockercfg-phbs5\""
Jul 13 19:10:10.596640 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.596635    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0a46d9\"/\"openshift-service-ca.crt\""
Jul 13 19:10:10.596725 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.596626    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0a46d9\"/\"kube-root-ca.crt\""
Jul 13 19:10:10.610845 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.610818    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"]
Jul 13 19:10:10.617160 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.617139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-dshm\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.617257 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.617165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-model-cache\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.617257 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.617200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-tmp-dir\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.617257 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.617247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-home\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.617382 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.617273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwkd8\" (UniqueName: \"kubernetes.io/projected/204921de-d824-493d-a798-8a58961dff79-kube-api-access-vwkd8\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.617382 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.617331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204921de-d824-493d-a798-8a58961dff79-tls-certs\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.718255 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.718217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-dshm\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.718255 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.718252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-model-cache\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.718541 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.718303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-tmp-dir\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.718541 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.718329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-home\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.718541 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.718353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwkd8\" (UniqueName: \"kubernetes.io/projected/204921de-d824-493d-a798-8a58961dff79-kube-api-access-vwkd8\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.718541 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.718407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204921de-d824-493d-a798-8a58961dff79-tls-certs\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.718810 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.718790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-model-cache\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.718874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.718817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-home\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.718874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.718845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-tmp-dir\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.720724 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.720697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-dshm\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.721009 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.720990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204921de-d824-493d-a798-8a58961dff79-tls-certs\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.728747 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.728721    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwkd8\" (UniqueName: \"kubernetes.io/projected/204921de-d824-493d-a798-8a58961dff79-kube-api-access-vwkd8\") pod \"test-model-0a46d9-kserve-575c5d75f7-wrz4b\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") " pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:10.901476 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:10.901444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:11.043884 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:11.043855    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"]
Jul 13 19:10:11.045915 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:10:11.045886    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod204921de_d824_493d_a798_8a58961dff79.slice/crio-4a6eec5a7729b6d535b01fcc1d82372f8119284c42bbeaa04b15b6a964b628c3 WatchSource:0}: Error finding container 4a6eec5a7729b6d535b01fcc1d82372f8119284c42bbeaa04b15b6a964b628c3: Status 404 returned error can't find the container with id 4a6eec5a7729b6d535b01fcc1d82372f8119284c42bbeaa04b15b6a964b628c3
Jul 13 19:10:11.955635 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:11.955600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b" event={"ID":"204921de-d824-493d-a798-8a58961dff79","Type":"ContainerStarted","Data":"a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b"}
Jul 13 19:10:11.955635 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:11.955642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b" event={"ID":"204921de-d824-493d-a798-8a58961dff79","Type":"ContainerStarted","Data":"4a6eec5a7729b6d535b01fcc1d82372f8119284c42bbeaa04b15b6a964b628c3"}
Jul 13 19:10:11.975265 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:11.975196    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b" podStartSLOduration=1.975174295 podStartE2EDuration="1.975174295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:10:11.974428516 +0000 UTC m=+2299.061534002" watchObservedRunningTime="2026-07-13 19:10:11.975174295 +0000 UTC m=+2299.062279762"
Jul 13 19:10:20.902238 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:20.902195    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:20.902740 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:20.902269    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:20.915220 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:20.915194    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:21.011689 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:21.011659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:28.548165 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:28.548120    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"]
Jul 13 19:10:43.569036 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.568971    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b" podUID="204921de-d824-493d-a798-8a58961dff79" containerName="main" containerID="cri-o://a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b" gracePeriod=45
Jul 13 19:10:43.824761 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.824689    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:43.933053 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933026    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwkd8\" (UniqueName: \"kubernetes.io/projected/204921de-d824-493d-a798-8a58961dff79-kube-api-access-vwkd8\") pod \"204921de-d824-493d-a798-8a58961dff79\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") "
Jul 13 19:10:43.933247 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933094    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204921de-d824-493d-a798-8a58961dff79-tls-certs\") pod \"204921de-d824-493d-a798-8a58961dff79\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") "
Jul 13 19:10:43.933247 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933214    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-home\") pod \"204921de-d824-493d-a798-8a58961dff79\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") "
Jul 13 19:10:43.933349 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933277    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-tmp-dir\") pod \"204921de-d824-493d-a798-8a58961dff79\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") "
Jul 13 19:10:43.933349 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933325    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-dshm\") pod \"204921de-d824-493d-a798-8a58961dff79\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") "
Jul 13 19:10:43.933462 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933361    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-model-cache\") pod \"204921de-d824-493d-a798-8a58961dff79\" (UID: \"204921de-d824-493d-a798-8a58961dff79\") "
Jul 13 19:10:43.933642 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933500    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-home" (OuterVolumeSpecName: "home") pod "204921de-d824-493d-a798-8a58961dff79" (UID: "204921de-d824-493d-a798-8a58961dff79"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:10:43.933642 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933567    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "204921de-d824-493d-a798-8a58961dff79" (UID: "204921de-d824-493d-a798-8a58961dff79"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:10:43.933763 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933708    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-model-cache" (OuterVolumeSpecName: "model-cache") pod "204921de-d824-493d-a798-8a58961dff79" (UID: "204921de-d824-493d-a798-8a58961dff79"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:10:43.933763 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933722    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-home\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:43.933763 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.933742    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-tmp-dir\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:43.935819 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.935795    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204921de-d824-493d-a798-8a58961dff79-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "204921de-d824-493d-a798-8a58961dff79" (UID: "204921de-d824-493d-a798-8a58961dff79"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:10:43.936245 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.936066    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/204921de-d824-493d-a798-8a58961dff79-kube-api-access-vwkd8" (OuterVolumeSpecName: "kube-api-access-vwkd8") pod "204921de-d824-493d-a798-8a58961dff79" (UID: "204921de-d824-493d-a798-8a58961dff79"). InnerVolumeSpecName "kube-api-access-vwkd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:10:43.936245 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:43.936076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-dshm" (OuterVolumeSpecName: "dshm") pod "204921de-d824-493d-a798-8a58961dff79" (UID: "204921de-d824-493d-a798-8a58961dff79"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:10:44.034428 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.034389    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-dshm\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:44.034428 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.034424    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204921de-d824-493d-a798-8a58961dff79-model-cache\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:44.034428 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.034435    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwkd8\" (UniqueName: \"kubernetes.io/projected/204921de-d824-493d-a798-8a58961dff79-kube-api-access-vwkd8\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:44.034680 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.034444    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204921de-d824-493d-a798-8a58961dff79-tls-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:44.111544 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.111439    2565 generic.go:356] "Generic (PLEG): container finished" podID="204921de-d824-493d-a798-8a58961dff79" containerID="a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b" exitCode=0
Jul 13 19:10:44.111544 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.111514    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"
Jul 13 19:10:44.111792 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.111505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b" event={"ID":"204921de-d824-493d-a798-8a58961dff79","Type":"ContainerDied","Data":"a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b"}
Jul 13 19:10:44.111792 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.111641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b" event={"ID":"204921de-d824-493d-a798-8a58961dff79","Type":"ContainerDied","Data":"4a6eec5a7729b6d535b01fcc1d82372f8119284c42bbeaa04b15b6a964b628c3"}
Jul 13 19:10:44.111792 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.111672    2565 scope.go:117] "RemoveContainer" containerID="a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b"
Jul 13 19:10:44.120819 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.120802    2565 scope.go:117] "RemoveContainer" containerID="a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b"
Jul 13 19:10:44.121038 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:10:44.121022    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b\": container with ID starting with a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b not found: ID does not exist" containerID="a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b"
Jul 13 19:10:44.121095 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.121048    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b"} err="failed to get container status \"a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b\": rpc error: code = NotFound desc = could not find container \"a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b\": container with ID starting with a22b18936fa33a08765ffbae635850078608b8b69edb7a1974a47803119af13b not found: ID does not exist"
Jul 13 19:10:44.134101 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.134074    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"]
Jul 13 19:10:44.138675 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:44.138653    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-0a46d9/test-model-0a46d9-kserve-575c5d75f7-wrz4b"]
Jul 13 19:10:45.466030 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:45.465928    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="204921de-d824-493d-a798-8a58961dff79" path="/var/lib/kubelet/pods/204921de-d824-493d-a798-8a58961dff79/volumes"
Jul 13 19:10:54.482252 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:54.482219    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"]
Jul 13 19:10:54.482692 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:54.482498    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy" containerID="cri-o://1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4" gracePeriod=30
Jul 13 19:10:59.740127 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.740099    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:10:59.773830 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.773756    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-credential-socket\") pod \"f211245f-6d05-4b30-8bbf-0948f9119e67\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") "
Jul 13 19:10:59.773830 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.773828    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4n47\" (UniqueName: \"kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-kube-api-access-x4n47\") pod \"f211245f-6d05-4b30-8bbf-0948f9119e67\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") "
Jul 13 19:10:59.774050 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.773895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-token\") pod \"f211245f-6d05-4b30-8bbf-0948f9119e67\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") "
Jul 13 19:10:59.774050 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.773917    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-certs\") pod \"f211245f-6d05-4b30-8bbf-0948f9119e67\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") "
Jul 13 19:10:59.774050 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.773941    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-envoy\") pod \"f211245f-6d05-4b30-8bbf-0948f9119e67\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") "
Jul 13 19:10:59.774203 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.774039    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f211245f-6d05-4b30-8bbf-0948f9119e67" (UID: "f211245f-6d05-4b30-8bbf-0948f9119e67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:10:59.774203 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.774090    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-data\") pod \"f211245f-6d05-4b30-8bbf-0948f9119e67\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") "
Jul 13 19:10:59.774203 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.774124    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f211245f-6d05-4b30-8bbf-0948f9119e67-istiod-ca-cert\") pod \"f211245f-6d05-4b30-8bbf-0948f9119e67\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") "
Jul 13 19:10:59.774203 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.774170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-podinfo\") pod \"f211245f-6d05-4b30-8bbf-0948f9119e67\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") "
Jul 13 19:10:59.774203 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.774189    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f211245f-6d05-4b30-8bbf-0948f9119e67" (UID: "f211245f-6d05-4b30-8bbf-0948f9119e67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:10:59.774488 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.774217    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-socket\") pod \"f211245f-6d05-4b30-8bbf-0948f9119e67\" (UID: \"f211245f-6d05-4b30-8bbf-0948f9119e67\") "
Jul 13 19:10:59.774560 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.774512    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:59.774560 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.774528    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-credential-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:59.775034 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.774985    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-data" (OuterVolumeSpecName: "istio-data") pod "f211245f-6d05-4b30-8bbf-0948f9119e67" (UID: "f211245f-6d05-4b30-8bbf-0948f9119e67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:10:59.775347 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.775311    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f211245f-6d05-4b30-8bbf-0948f9119e67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f211245f-6d05-4b30-8bbf-0948f9119e67" (UID: "f211245f-6d05-4b30-8bbf-0948f9119e67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:10:59.775555 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.775532    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f211245f-6d05-4b30-8bbf-0948f9119e67" (UID: "f211245f-6d05-4b30-8bbf-0948f9119e67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:10:59.776492 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.776447    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-kube-api-access-x4n47" (OuterVolumeSpecName: "kube-api-access-x4n47") pod "f211245f-6d05-4b30-8bbf-0948f9119e67" (UID: "f211245f-6d05-4b30-8bbf-0948f9119e67"). InnerVolumeSpecName "kube-api-access-x4n47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:10:59.776599 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.776447    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f211245f-6d05-4b30-8bbf-0948f9119e67" (UID: "f211245f-6d05-4b30-8bbf-0948f9119e67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:10:59.776961 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.776941    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-token" (OuterVolumeSpecName: "istio-token") pod "f211245f-6d05-4b30-8bbf-0948f9119e67" (UID: "f211245f-6d05-4b30-8bbf-0948f9119e67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:10:59.777438 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.777417    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f211245f-6d05-4b30-8bbf-0948f9119e67" (UID: "f211245f-6d05-4b30-8bbf-0948f9119e67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:10:59.875535 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.875494    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-envoy\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:59.875535 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.875533    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-data\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:59.875535 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.875547    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f211245f-6d05-4b30-8bbf-0948f9119e67-istiod-ca-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:59.875860 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.875560    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-podinfo\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:59.875860 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.875573    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f211245f-6d05-4b30-8bbf-0948f9119e67-workload-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:59.875860 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.875588    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4n47\" (UniqueName: \"kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-kube-api-access-x4n47\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:10:59.875860 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:10:59.875602    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f211245f-6d05-4b30-8bbf-0948f9119e67-istio-token\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:11:00.195459 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.195425    2565 generic.go:356] "Generic (PLEG): container finished" podID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerID="1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4" exitCode=0
Jul 13 19:11:00.195644 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.195511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" event={"ID":"f211245f-6d05-4b30-8bbf-0948f9119e67","Type":"ContainerDied","Data":"1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4"}
Jul 13 19:11:00.195644 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.195587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95" event={"ID":"f211245f-6d05-4b30-8bbf-0948f9119e67","Type":"ContainerDied","Data":"c911eb82428c77fcb19b5cd76b013600b991a9fece82420df9ed02baa977c37d"}
Jul 13 19:11:00.195644 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.195521    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"
Jul 13 19:11:00.195849 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.195609    2565 scope.go:117] "RemoveContainer" containerID="1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4"
Jul 13 19:11:00.205017 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.204999    2565 scope.go:117] "RemoveContainer" containerID="bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4"
Jul 13 19:11:00.212943 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.212923    2565 scope.go:117] "RemoveContainer" containerID="1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4"
Jul 13 19:11:00.213192 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:11:00.213172    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4\": container with ID starting with 1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4 not found: ID does not exist" containerID="1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4"
Jul 13 19:11:00.213255 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.213200    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4"} err="failed to get container status \"1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4\": rpc error: code = NotFound desc = could not find container \"1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4\": container with ID starting with 1b5a4650460b70bb0d8e31800b42f9325e09edf57989d520c4a55b1b2c3a1eb4 not found: ID does not exist"
Jul 13 19:11:00.213255 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.213219    2565 scope.go:117] "RemoveContainer" containerID="bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4"
Jul 13 19:11:00.213452 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:11:00.213433    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4\": container with ID starting with bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4 not found: ID does not exist" containerID="bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4"
Jul 13 19:11:00.213526 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.213458    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4"} err="failed to get container status \"bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4\": rpc error: code = NotFound desc = could not find container \"bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4\": container with ID starting with bb906f23bc6fc4e051463d9eef2100993c5b0bdfff7be489f7221930b0c212c4 not found: ID does not exist"
Jul 13 19:11:00.219282 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.219260    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"]
Jul 13 19:11:00.225308 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:00.225287    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5d44da-openshift-default-76bd4fb889-9jp95"]
Jul 13 19:11:01.465374 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:01.465342    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" path="/var/lib/kubelet/pods/f211245f-6d05-4b30-8bbf-0948f9119e67/volumes"
Jul 13 19:11:20.655115 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:20.655075    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"]
Jul 13 19:11:20.655714 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:20.655329    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy" containerID="cri-o://5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e" gracePeriod=30
Jul 13 19:11:25.912720 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:25.912695    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:11:26.008153 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008054    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80426357-1d74-4746-ba9e-6491e53eafe7-istiod-ca-cert\") pod \"80426357-1d74-4746-ba9e-6491e53eafe7\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") "
Jul 13 19:11:26.008153 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008103    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-credential-socket\") pod \"80426357-1d74-4746-ba9e-6491e53eafe7\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") "
Jul 13 19:11:26.008153 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008142    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80426357-1d74-4746-ba9e-6491e53eafe7-istio-podinfo\") pod \"80426357-1d74-4746-ba9e-6491e53eafe7\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") "
Jul 13 19:11:26.008435 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008193    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh9tb\" (UniqueName: \"kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-kube-api-access-dh9tb\") pod \"80426357-1d74-4746-ba9e-6491e53eafe7\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") "
Jul 13 19:11:26.008435 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008220    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-data\") pod \"80426357-1d74-4746-ba9e-6491e53eafe7\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") "
Jul 13 19:11:26.008435 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008306    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-socket\") pod \"80426357-1d74-4746-ba9e-6491e53eafe7\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") "
Jul 13 19:11:26.008435 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-istio-token\") pod \"80426357-1d74-4746-ba9e-6491e53eafe7\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") "
Jul 13 19:11:26.008435 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008436    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-certs\") pod \"80426357-1d74-4746-ba9e-6491e53eafe7\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") "
Jul 13 19:11:26.008727 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008461    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-envoy\") pod \"80426357-1d74-4746-ba9e-6491e53eafe7\" (UID: \"80426357-1d74-4746-ba9e-6491e53eafe7\") "
Jul 13 19:11:26.008727 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008543    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80426357-1d74-4746-ba9e-6491e53eafe7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "80426357-1d74-4746-ba9e-6491e53eafe7" (UID: "80426357-1d74-4746-ba9e-6491e53eafe7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:11:26.008727 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008539    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "80426357-1d74-4746-ba9e-6491e53eafe7" (UID: "80426357-1d74-4746-ba9e-6491e53eafe7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:11:26.008889 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008772    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-credential-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:11:26.008889 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008792    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80426357-1d74-4746-ba9e-6491e53eafe7-istiod-ca-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:11:26.008889 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008832    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "80426357-1d74-4746-ba9e-6491e53eafe7" (UID: "80426357-1d74-4746-ba9e-6491e53eafe7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:11:26.009034 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.008892    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "80426357-1d74-4746-ba9e-6491e53eafe7" (UID: "80426357-1d74-4746-ba9e-6491e53eafe7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:11:26.009419 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.009397    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-data" (OuterVolumeSpecName: "istio-data") pod "80426357-1d74-4746-ba9e-6491e53eafe7" (UID: "80426357-1d74-4746-ba9e-6491e53eafe7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:11:26.010736 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.010709    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80426357-1d74-4746-ba9e-6491e53eafe7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "80426357-1d74-4746-ba9e-6491e53eafe7" (UID: "80426357-1d74-4746-ba9e-6491e53eafe7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:11:26.010736 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.010718    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "80426357-1d74-4746-ba9e-6491e53eafe7" (UID: "80426357-1d74-4746-ba9e-6491e53eafe7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:11:26.011102 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.011077    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-kube-api-access-dh9tb" (OuterVolumeSpecName: "kube-api-access-dh9tb") pod "80426357-1d74-4746-ba9e-6491e53eafe7" (UID: "80426357-1d74-4746-ba9e-6491e53eafe7"). InnerVolumeSpecName "kube-api-access-dh9tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:11:26.011185 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.011099    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-istio-token" (OuterVolumeSpecName: "istio-token") pod "80426357-1d74-4746-ba9e-6491e53eafe7" (UID: "80426357-1d74-4746-ba9e-6491e53eafe7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:11:26.109793 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.109760    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80426357-1d74-4746-ba9e-6491e53eafe7-istio-podinfo\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:11:26.109793 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.109786    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh9tb\" (UniqueName: \"kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-kube-api-access-dh9tb\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:11:26.109793 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.109796    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-data\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:11:26.110031 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.109806    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:11:26.110031 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.109815    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80426357-1d74-4746-ba9e-6491e53eafe7-istio-token\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:11:26.110031 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.109823    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-workload-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:11:26.110031 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.109830    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80426357-1d74-4746-ba9e-6491e53eafe7-istio-envoy\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:11:26.324171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.324073    2565 generic.go:356] "Generic (PLEG): container finished" podID="80426357-1d74-4746-ba9e-6491e53eafe7" containerID="5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e" exitCode=0
Jul 13 19:11:26.324171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.324128    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"
Jul 13 19:11:26.324171 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.324157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" event={"ID":"80426357-1d74-4746-ba9e-6491e53eafe7","Type":"ContainerDied","Data":"5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e"}
Jul 13 19:11:26.324394 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.324213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2" event={"ID":"80426357-1d74-4746-ba9e-6491e53eafe7","Type":"ContainerDied","Data":"9bf0fbc27d46522dfd88892466992ec8cbf5d06e8a2e5b7976afbe5b59750055"}
Jul 13 19:11:26.324394 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.324237    2565 scope.go:117] "RemoveContainer" containerID="5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e"
Jul 13 19:11:26.333743 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.333726    2565 scope.go:117] "RemoveContainer" containerID="5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb"
Jul 13 19:11:26.341659 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.341640    2565 scope.go:117] "RemoveContainer" containerID="5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e"
Jul 13 19:11:26.341915 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:11:26.341897    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e\": container with ID starting with 5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e not found: ID does not exist" containerID="5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e"
Jul 13 19:11:26.341967 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.341924    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e"} err="failed to get container status \"5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e\": rpc error: code = NotFound desc = could not find container \"5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e\": container with ID starting with 5fda0dd179f3b6a9f7b1d226d295a2c3ec71fdc726541cac73211ac6d346fa8e not found: ID does not exist"
Jul 13 19:11:26.341967 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.341941    2565 scope.go:117] "RemoveContainer" containerID="5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb"
Jul 13 19:11:26.342164 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:11:26.342145    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb\": container with ID starting with 5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb not found: ID does not exist" containerID="5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb"
Jul 13 19:11:26.342206 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.342172    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb"} err="failed to get container status \"5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb\": rpc error: code = NotFound desc = could not find container \"5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb\": container with ID starting with 5cb0dcb6ee074dadfc772471c53163d7c81d62f747b07f0a1e53f050b9927afb not found: ID does not exist"
Jul 13 19:11:26.345897 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.345875    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"]
Jul 13 19:11:26.349351 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:26.349329    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-0a46d9-openshift-default-6846948647-p9hj2"]
Jul 13 19:11:27.465898 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:27.465856    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" path="/var/lib/kubelet/pods/80426357-1d74-4746-ba9e-6491e53eafe7/volumes"
Jul 13 19:11:32.262385 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262354    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"]
Jul 13 19:11:32.262761 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262738    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy"
Jul 13 19:11:32.262761 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262751    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy"
Jul 13 19:11:32.262831 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262763    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204921de-d824-493d-a798-8a58961dff79" containerName="main"
Jul 13 19:11:32.262831 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262769    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="204921de-d824-493d-a798-8a58961dff79" containerName="main"
Jul 13 19:11:32.262831 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262777    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy"
Jul 13 19:11:32.262831 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262782    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy"
Jul 13 19:11:32.262831 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262797    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy"
Jul 13 19:11:32.262831 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262805    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy"
Jul 13 19:11:32.263007 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262868    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy"
Jul 13 19:11:32.263007 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262881    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="204921de-d824-493d-a798-8a58961dff79" containerName="main"
Jul 13 19:11:32.263007 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.262888    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy"
Jul 13 19:11:32.264971 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.264931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.265538 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.265505    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-data\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.265664 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.265560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fhkh\" (UniqueName: \"kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-kube-api-access-9fhkh\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.265664 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.265612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-envoy\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.265750 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.265705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istiod-ca-cert\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.265750 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.265739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-podinfo\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.265849 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.265764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-credential-socket\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.265849 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.265798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-certs\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.265849 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.265822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-socket\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.265966 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.265884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-token\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.268008 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.267988    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5ffdec-openshift-default-dockercfg-n2sct\""
Jul 13 19:11:32.285075 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.285053    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"]
Jul 13 19:11:32.367266 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.367230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-socket\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.367505 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.367309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-token\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.367505 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.367347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-data\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.367505 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.367379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fhkh\" (UniqueName: \"kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-kube-api-access-9fhkh\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.367832 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.367777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-envoy\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.367832 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.367807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-socket\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.368007 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.367908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istiod-ca-cert\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.368007 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.367952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-podinfo\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.368007 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.367978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-credential-socket\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.368165 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.368009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-certs\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.368297 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.368253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-data\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.368297 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.368284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-certs\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.368776 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.368731    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-credential-socket\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.369034 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.368975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istiod-ca-cert\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.370696 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.370676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-envoy\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.371355 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.371334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-podinfo\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.378513 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.378463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fhkh\" (UniqueName: \"kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-kube-api-access-9fhkh\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.378634 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.378612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-token\") pod \"e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") " pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.576577 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.576485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:32.717100 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.717076    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"]
Jul 13 19:11:32.719178 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:11:32.719151    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1beab14_d0be_40c4_a6a7_2b5e9215a209.slice/crio-89c28f3817c762ac015149ecfdb8140c1feabe464b666a75a4f41344a257f800 WatchSource:0}: Error finding container 89c28f3817c762ac015149ecfdb8140c1feabe464b666a75a4f41344a257f800: Status 404 returned error can't find the container with id 89c28f3817c762ac015149ecfdb8140c1feabe464b666a75a4f41344a257f800
Jul 13 19:11:32.721358 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.721316    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:11:32.721460 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.721405    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:11:32.721460 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:32.721453    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:11:33.360866 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:33.360829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" event={"ID":"e1beab14-d0be-40c4-a6a7-2b5e9215a209","Type":"ContainerStarted","Data":"8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c"}
Jul 13 19:11:33.361350 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:33.360893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" event={"ID":"e1beab14-d0be-40c4-a6a7-2b5e9215a209","Type":"ContainerStarted","Data":"89c28f3817c762ac015149ecfdb8140c1feabe464b666a75a4f41344a257f800"}
Jul 13 19:11:33.398094 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:33.398046    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" podStartSLOduration=1.398030914 podStartE2EDuration="1.398030914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:11:33.394966072 +0000 UTC m=+2380.482071537" watchObservedRunningTime="2026-07-13 19:11:33.398030914 +0000 UTC m=+2380.485136439"
Jul 13 19:11:33.576864 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:33.576832    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:33.581646 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:33.581613    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:34.365644 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:34.365611    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:34.366621 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:34.366597    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:46.431699 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:46.431661    2565 generic.go:356] "Generic (PLEG): container finished" podID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerID="8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c" exitCode=0
Jul 13 19:11:46.432143 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:46.431722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" event={"ID":"e1beab14-d0be-40c4-a6a7-2b5e9215a209","Type":"ContainerDied","Data":"8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c"}
Jul 13 19:11:46.432143 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:46.432090    2565 scope.go:117] "RemoveContainer" containerID="8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c"
Jul 13 19:11:46.433086 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:46.433056    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:11:46.433177 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:46.433122    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:11:46.433177 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:46.433153    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:11:47.438339 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:47.438305    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" event={"ID":"e1beab14-d0be-40c4-a6a7-2b5e9215a209","Type":"ContainerStarted","Data":"7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e"}
Jul 13 19:11:47.577752 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:47.577711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:47.579081 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:47.579054    2565 patch_prober.go:28] interesting pod/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 13 19:11:47.579229 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:47.579115    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 13 19:11:48.577325 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:48.577286    2565 patch_prober.go:28] interesting pod/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 13 19:11:48.577954 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:48.577920    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 13 19:11:49.366175 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:49.366141    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:49.580944 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:49.580902    2565 patch_prober.go:28] interesting pod/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 13 19:11:49.581404 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:49.580970    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 13 19:11:50.577823 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:50.577775    2565 patch_prober.go:28] interesting pod/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 13 19:11:50.578046 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:50.577847    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 13 19:11:51.577277 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:51.577236    2565 patch_prober.go:28] interesting pod/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 13 19:11:51.578040 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:51.578002    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 13 19:11:52.581671 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:52.581635    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:52.582746 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:52.582717    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:11:53.487849 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:53.487822    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 19:11:53.492757 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:53.492729    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 19:11:53.494958 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:53.494932    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 19:11:53.499311 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:11:53.499293    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 19:12:39.889540 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:39.889500    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"]
Jul 13 19:12:39.890014 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:39.889760    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy" containerID="cri-o://7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e" gracePeriod=30
Jul 13 19:12:45.142702 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.142675    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:12:45.228184 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228071    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-envoy\") pod \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") "
Jul 13 19:12:45.228184 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-token\") pod \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") "
Jul 13 19:12:45.228184 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228175    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-data\") pod \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") "
Jul 13 19:12:45.228512 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fhkh\" (UniqueName: \"kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-kube-api-access-9fhkh\") pod \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") "
Jul 13 19:12:45.228512 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228217    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-podinfo\") pod \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") "
Jul 13 19:12:45.228512 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228265    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-credential-socket\") pod \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") "
Jul 13 19:12:45.228512 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228333    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istiod-ca-cert\") pod \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") "
Jul 13 19:12:45.228512 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228357    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-socket\") pod \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") "
Jul 13 19:12:45.228512 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228378    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-certs\") pod \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\" (UID: \"e1beab14-d0be-40c4-a6a7-2b5e9215a209\") "
Jul 13 19:12:45.228863 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228822    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1beab14-d0be-40c4-a6a7-2b5e9215a209" (UID: "e1beab14-d0be-40c4-a6a7-2b5e9215a209"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:12:45.229094 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.228931    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1beab14-d0be-40c4-a6a7-2b5e9215a209" (UID: "e1beab14-d0be-40c4-a6a7-2b5e9215a209"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:12:45.229094 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.229014    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1beab14-d0be-40c4-a6a7-2b5e9215a209" (UID: "e1beab14-d0be-40c4-a6a7-2b5e9215a209"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:12:45.229094 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.229062    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1beab14-d0be-40c4-a6a7-2b5e9215a209" (UID: "e1beab14-d0be-40c4-a6a7-2b5e9215a209"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:12:45.229552 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.229519    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1beab14-d0be-40c4-a6a7-2b5e9215a209" (UID: "e1beab14-d0be-40c4-a6a7-2b5e9215a209"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:12:45.230849 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.230820    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1beab14-d0be-40c4-a6a7-2b5e9215a209" (UID: "e1beab14-d0be-40c4-a6a7-2b5e9215a209"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:12:45.230979 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.230881    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-kube-api-access-9fhkh" (OuterVolumeSpecName: "kube-api-access-9fhkh") pod "e1beab14-d0be-40c4-a6a7-2b5e9215a209" (UID: "e1beab14-d0be-40c4-a6a7-2b5e9215a209"). InnerVolumeSpecName "kube-api-access-9fhkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:12:45.230979 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.230947    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1beab14-d0be-40c4-a6a7-2b5e9215a209" (UID: "e1beab14-d0be-40c4-a6a7-2b5e9215a209"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:12:45.231065 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.231002    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1beab14-d0be-40c4-a6a7-2b5e9215a209" (UID: "e1beab14-d0be-40c4-a6a7-2b5e9215a209"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:12:45.329391 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.329351    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istiod-ca-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:12:45.329391 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.329382    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:12:45.329391 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.329393    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-workload-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:12:45.329391 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.329401    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-envoy\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:12:45.329697 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.329410    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-token\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:12:45.329697 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.329417    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-data\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:12:45.329697 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.329425    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fhkh\" (UniqueName: \"kubernetes.io/projected/e1beab14-d0be-40c4-a6a7-2b5e9215a209-kube-api-access-9fhkh\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:12:45.329697 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.329433    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1beab14-d0be-40c4-a6a7-2b5e9215a209-istio-podinfo\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:12:45.329697 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.329441    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beab14-d0be-40c4-a6a7-2b5e9215a209-credential-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:12:45.715608 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.715572    2565 generic.go:356] "Generic (PLEG): container finished" podID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerID="7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e" exitCode=0
Jul 13 19:12:45.715791 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.715622    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"
Jul 13 19:12:45.715791 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.715649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" event={"ID":"e1beab14-d0be-40c4-a6a7-2b5e9215a209","Type":"ContainerDied","Data":"7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e"}
Jul 13 19:12:45.715791 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.715703    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm" event={"ID":"e1beab14-d0be-40c4-a6a7-2b5e9215a209","Type":"ContainerDied","Data":"89c28f3817c762ac015149ecfdb8140c1feabe464b666a75a4f41344a257f800"}
Jul 13 19:12:45.715791 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.715725    2565 scope.go:117] "RemoveContainer" containerID="7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e"
Jul 13 19:12:45.724637 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.724623    2565 scope.go:117] "RemoveContainer" containerID="8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c"
Jul 13 19:12:45.732441 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.732417    2565 scope.go:117] "RemoveContainer" containerID="7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e"
Jul 13 19:12:45.732826 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:12:45.732798    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e\": container with ID starting with 7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e not found: ID does not exist" containerID="7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e"
Jul 13 19:12:45.732953 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.732838    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e"} err="failed to get container status \"7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e\": rpc error: code = NotFound desc = could not find container \"7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e\": container with ID starting with 7a10d13f8292f24188bbf36e3d11b800b7c6a5397f540546cbaacf8a1118120e not found: ID does not exist"
Jul 13 19:12:45.732953 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.732864    2565 scope.go:117] "RemoveContainer" containerID="8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c"
Jul 13 19:12:45.733207 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:12:45.733183    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c\": container with ID starting with 8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c not found: ID does not exist" containerID="8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c"
Jul 13 19:12:45.733291 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.733215    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c"} err="failed to get container status \"8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c\": rpc error: code = NotFound desc = could not find container \"8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c\": container with ID starting with 8b595603df0f8c2f01cf820e78ca9de0a2072eed3693e4cc519594be9025a36c not found: ID does not exist"
Jul 13 19:12:45.735005 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.734985    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"]
Jul 13 19:12:45.739173 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:45.739151    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5ffdec-openshift-default-77564c7595-6rplm"]
Jul 13 19:12:47.465531 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:47.465497    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" path="/var/lib/kubelet/pods/e1beab14-d0be-40c4-a6a7-2b5e9215a209/volumes"
Jul 13 19:12:49.511932 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.511900    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"]
Jul 13 19:12:49.512385 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.512259    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy"
Jul 13 19:12:49.512385 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.512270    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy"
Jul 13 19:12:49.512385 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.512288    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy"
Jul 13 19:12:49.512385 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.512293    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy"
Jul 13 19:12:49.512385 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.512366    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy"
Jul 13 19:12:49.512385 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.512375    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80426357-1d74-4746-ba9e-6491e53eafe7" containerName="istio-proxy"
Jul 13 19:12:49.512385 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.512381    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f211245f-6d05-4b30-8bbf-0948f9119e67" containerName="istio-proxy"
Jul 13 19:12:49.516824 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.516801    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.519509 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.519484    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e91902-openshift-default-dockercfg-jztgg\""
Jul 13 19:12:49.529013 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.528990    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"]
Jul 13 19:12:49.671138 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.671096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-credential-socket\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.671316 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.671153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-istio-token\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.671316 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.671242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-socket\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.671316 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.671300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-data\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.671420 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.671363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjkr5\" (UniqueName: \"kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-kube-api-access-vjkr5\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.671420 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.671386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-envoy\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.671523 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.671418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-certs\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.671523 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.671442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75cfd725-5002-4974-9122-16fc143e4376-istiod-ca-cert\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.671589 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.671521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75cfd725-5002-4974-9122-16fc143e4376-istio-podinfo\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772026 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.771916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-credential-socket\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772026 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.771968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-istio-token\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772026 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.771995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-socket\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772026 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-data\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772362 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjkr5\" (UniqueName: \"kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-kube-api-access-vjkr5\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772362 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-envoy\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772362 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-certs\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772362 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75cfd725-5002-4974-9122-16fc143e4376-istiod-ca-cert\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772362 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75cfd725-5002-4974-9122-16fc143e4376-istio-podinfo\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772362 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-credential-socket\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772708 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-data\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772708 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772563    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-certs\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.772708 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-socket\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.773054 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.772989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75cfd725-5002-4974-9122-16fc143e4376-istiod-ca-cert\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.774757 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.774733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-envoy\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.774849 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.774772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75cfd725-5002-4974-9122-16fc143e4376-istio-podinfo\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.782049 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.782026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjkr5\" (UniqueName: \"kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-kube-api-access-vjkr5\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.782221 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.782094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-istio-token\") pod \"e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") " pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.827354 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.827311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:49.973860 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.973781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"]
Jul 13 19:12:49.976142 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:12:49.976116    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75cfd725_5002_4974_9122_16fc143e4376.slice/crio-da682b41ae7737554cccb498e0a41d3c64db6a7af1c9ebefd7a4d08c15ccfef6 WatchSource:0}: Error finding container da682b41ae7737554cccb498e0a41d3c64db6a7af1c9ebefd7a4d08c15ccfef6: Status 404 returned error can't find the container with id da682b41ae7737554cccb498e0a41d3c64db6a7af1c9ebefd7a4d08c15ccfef6
Jul 13 19:12:49.978263 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.978225    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:12:49.978328 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.978295    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:12:49.978364 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:49.978326    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:12:50.740308 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:50.740272    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" event={"ID":"75cfd725-5002-4974-9122-16fc143e4376","Type":"ContainerStarted","Data":"da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f"}
Jul 13 19:12:50.740711 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:50.740337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" event={"ID":"75cfd725-5002-4974-9122-16fc143e4376","Type":"ContainerStarted","Data":"da682b41ae7737554cccb498e0a41d3c64db6a7af1c9ebefd7a4d08c15ccfef6"}
Jul 13 19:12:50.764012 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:50.763967    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" podStartSLOduration=1.763952727 podStartE2EDuration="1.763952727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:12:50.762625549 +0000 UTC m=+2457.849731024" watchObservedRunningTime="2026-07-13 19:12:50.763952727 +0000 UTC m=+2457.851058191"
Jul 13 19:12:50.828209 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:50.828178    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:51.833026 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:51.832989    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:52.750224 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:52.750191    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:12:52.751120 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:12:52.751102    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:13:06.828796 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:06.828760    2565 generic.go:356] "Generic (PLEG): container finished" podID="75cfd725-5002-4974-9122-16fc143e4376" containerID="da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f" exitCode=0
Jul 13 19:13:06.829213 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:06.828818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" event={"ID":"75cfd725-5002-4974-9122-16fc143e4376","Type":"ContainerDied","Data":"da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f"}
Jul 13 19:13:06.829213 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:06.829195    2565 scope.go:117] "RemoveContainer" containerID="da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f"
Jul 13 19:13:06.830204 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:06.830174    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:13:06.830252 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:06.830240    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:13:06.830286 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:06.830269    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:13:07.751199 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:07.751139    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:13:07.835193 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:07.835158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" event={"ID":"75cfd725-5002-4974-9122-16fc143e4376","Type":"ContainerStarted","Data":"05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32"}
Jul 13 19:13:08.827846 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:08.827809    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:13:08.828974 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:08.828951    2565 patch_prober.go:28] interesting pod/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 13 19:13:08.829079 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:08.829000    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 13 19:13:09.827644 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:09.827610    2565 patch_prober.go:28] interesting pod/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 13 19:13:09.828029 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:09.827665    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 13 19:13:10.827806 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:10.827768    2565 patch_prober.go:28] interesting pod/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 13 19:13:10.828192 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:10.827828    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 13 19:13:11.828117 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:11.828074    2565 patch_prober.go:28] interesting pod/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 13 19:13:11.828564 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:11.828152    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 13 19:13:12.832075 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:12.832044    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:13:12.832511 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:12.832309    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:13:12.833069 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:12.833049    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:13:22.247044 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.247004    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"]
Jul 13 19:13:22.247430 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.247362    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy"
Jul 13 19:13:22.247430 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.247374    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy"
Jul 13 19:13:22.247538 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.247437    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1beab14-d0be-40c4-a6a7-2b5e9215a209" containerName="istio-proxy"
Jul 13 19:13:22.250564 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.250547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"
Jul 13 19:13:22.253338 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.253317    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lkrf8\""
Jul 13 19:13:22.253602 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.253586    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 19:13:22.260163 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.260138    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"]
Jul 13 19:13:22.376429 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.376392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5eb69fa-c113-4374-b12e-5bade9ed22f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-78327326-pcjgk\" (UID: \"d5eb69fa-c113-4374-b12e-5bade9ed22f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"
Jul 13 19:13:22.477501 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.477433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5eb69fa-c113-4374-b12e-5bade9ed22f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-78327326-pcjgk\" (UID: \"d5eb69fa-c113-4374-b12e-5bade9ed22f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"
Jul 13 19:13:22.478146 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.478123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5eb69fa-c113-4374-b12e-5bade9ed22f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-78327326-pcjgk\" (UID: \"d5eb69fa-c113-4374-b12e-5bade9ed22f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"
Jul 13 19:13:22.562509 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.562394    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"
Jul 13 19:13:22.703777 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.703739    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"]
Jul 13 19:13:22.705043 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:13:22.705020    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5eb69fa_c113_4374_b12e_5bade9ed22f6.slice/crio-e63cafd9cf49bfad9a4f1d5885b7b20442943b9c8ba23cdd159d77aa372ec5fd WatchSource:0}: Error finding container e63cafd9cf49bfad9a4f1d5885b7b20442943b9c8ba23cdd159d77aa372ec5fd: Status 404 returned error can't find the container with id e63cafd9cf49bfad9a4f1d5885b7b20442943b9c8ba23cdd159d77aa372ec5fd
Jul 13 19:13:22.908689 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:22.908660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk" event={"ID":"d5eb69fa-c113-4374-b12e-5bade9ed22f6","Type":"ContainerStarted","Data":"e63cafd9cf49bfad9a4f1d5885b7b20442943b9c8ba23cdd159d77aa372ec5fd"}
Jul 13 19:13:23.914546 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:23.914510    2565 generic.go:356] "Generic (PLEG): container finished" podID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerID="c5ac6178a749688b19d70488b394163003d1961e88924fac2a4fe9c8f9c04c62" exitCode=6
Jul 13 19:13:23.914920 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:23.914559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk" event={"ID":"d5eb69fa-c113-4374-b12e-5bade9ed22f6","Type":"ContainerDied","Data":"c5ac6178a749688b19d70488b394163003d1961e88924fac2a4fe9c8f9c04c62"}
Jul 13 19:13:23.914920 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:23.914761    2565 scope.go:117] "RemoveContainer" containerID="c5ac6178a749688b19d70488b394163003d1961e88924fac2a4fe9c8f9c04c62"
Jul 13 19:13:24.920884 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:24.920846    2565 generic.go:356] "Generic (PLEG): container finished" podID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerID="796a2dadfaf752204f2259456ee717c7d5bb60acf4b7f9a992c1fa7049080673" exitCode=6
Jul 13 19:13:24.921279 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:24.920924    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk" event={"ID":"d5eb69fa-c113-4374-b12e-5bade9ed22f6","Type":"ContainerDied","Data":"796a2dadfaf752204f2259456ee717c7d5bb60acf4b7f9a992c1fa7049080673"}
Jul 13 19:13:24.921279 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:24.921011    2565 scope.go:117] "RemoveContainer" containerID="c5ac6178a749688b19d70488b394163003d1961e88924fac2a4fe9c8f9c04c62"
Jul 13 19:13:24.921279 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:24.921156    2565 scope.go:117] "RemoveContainer" containerID="796a2dadfaf752204f2259456ee717c7d5bb60acf4b7f9a992c1fa7049080673"
Jul 13 19:13:24.921445 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:13:24.921425    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-78327326-pcjgk_odh-ai-gateway-infra(d5eb69fa-c113-4374-b12e-5bade9ed22f6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6"
Jul 13 19:13:25.928228 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:25.928200    2565 scope.go:117] "RemoveContainer" containerID="796a2dadfaf752204f2259456ee717c7d5bb60acf4b7f9a992c1fa7049080673"
Jul 13 19:13:25.928632 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:13:25.928420    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-78327326-pcjgk_odh-ai-gateway-infra(d5eb69fa-c113-4374-b12e-5bade9ed22f6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6"
Jul 13 19:13:36.459663 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:36.459634    2565 scope.go:117] "RemoveContainer" containerID="796a2dadfaf752204f2259456ee717c7d5bb60acf4b7f9a992c1fa7049080673"
Jul 13 19:13:36.993187 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:36.993152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk" event={"ID":"d5eb69fa-c113-4374-b12e-5bade9ed22f6","Type":"ContainerStarted","Data":"ddcc333d5b1a123a418812020443fab21eb7a479e817ae6b57f054e806c07789"}
Jul 13 19:13:37.013232 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:37.013168    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk" podStartSLOduration=15.013154172 podStartE2EDuration="15.013154172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:13:37.011718665 +0000 UTC m=+2504.098824129" watchObservedRunningTime="2026-07-13 19:13:37.013154172 +0000 UTC m=+2504.100259636"
Jul 13 19:13:37.999762 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:37.999715    2565 generic.go:356] "Generic (PLEG): container finished" podID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerID="ddcc333d5b1a123a418812020443fab21eb7a479e817ae6b57f054e806c07789" exitCode=6
Jul 13 19:13:38.000229 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:37.999787    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk" event={"ID":"d5eb69fa-c113-4374-b12e-5bade9ed22f6","Type":"ContainerDied","Data":"ddcc333d5b1a123a418812020443fab21eb7a479e817ae6b57f054e806c07789"}
Jul 13 19:13:38.000229 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:37.999846    2565 scope.go:117] "RemoveContainer" containerID="796a2dadfaf752204f2259456ee717c7d5bb60acf4b7f9a992c1fa7049080673"
Jul 13 19:13:38.000229 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:38.000118    2565 scope.go:117] "RemoveContainer" containerID="ddcc333d5b1a123a418812020443fab21eb7a479e817ae6b57f054e806c07789"
Jul 13 19:13:38.000381 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:13:38.000360    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-78327326-pcjgk_odh-ai-gateway-infra(d5eb69fa-c113-4374-b12e-5bade9ed22f6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6"
Jul 13 19:13:38.026449 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:38.026420    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"]
Jul 13 19:13:39.142786 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:39.142761    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"
Jul 13 19:13:39.225778 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:39.225745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5eb69fa-c113-4374-b12e-5bade9ed22f6-maas-api-service-ca\") pod \"d5eb69fa-c113-4374-b12e-5bade9ed22f6\" (UID: \"d5eb69fa-c113-4374-b12e-5bade9ed22f6\") "
Jul 13 19:13:39.226126 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:39.226103    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5eb69fa-c113-4374-b12e-5bade9ed22f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d5eb69fa-c113-4374-b12e-5bade9ed22f6" (UID: "d5eb69fa-c113-4374-b12e-5bade9ed22f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:13:39.327347 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:39.327256    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5eb69fa-c113-4374-b12e-5bade9ed22f6-maas-api-service-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:13:40.011392 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:40.011363    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"
Jul 13 19:13:40.011596 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:40.011368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk" event={"ID":"d5eb69fa-c113-4374-b12e-5bade9ed22f6","Type":"ContainerDied","Data":"e63cafd9cf49bfad9a4f1d5885b7b20442943b9c8ba23cdd159d77aa372ec5fd"}
Jul 13 19:13:40.011596 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:40.011513    2565 scope.go:117] "RemoveContainer" containerID="ddcc333d5b1a123a418812020443fab21eb7a479e817ae6b57f054e806c07789"
Jul 13 19:13:40.035294 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:40.035262    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"]
Jul 13 19:13:40.042139 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:40.042108    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-pcjgk"]
Jul 13 19:13:41.465376 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:13:41.465340    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" path="/var/lib/kubelet/pods/d5eb69fa-c113-4374-b12e-5bade9ed22f6/volumes"
Jul 13 19:14:06.171185 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.171152    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"]
Jul 13 19:14:06.171578 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.171529    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerName="revoke-keys"
Jul 13 19:14:06.171578 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.171541    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerName="revoke-keys"
Jul 13 19:14:06.171578 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.171557    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerName="revoke-keys"
Jul 13 19:14:06.171578 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.171563    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerName="revoke-keys"
Jul 13 19:14:06.171578 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.171573    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerName="revoke-keys"
Jul 13 19:14:06.171578 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.171579    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerName="revoke-keys"
Jul 13 19:14:06.171785 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.171640    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerName="revoke-keys"
Jul 13 19:14:06.171785 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.171647    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerName="revoke-keys"
Jul 13 19:14:06.174415 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.174396    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.178693 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.178670    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"openshift-service-ca.crt\""
Jul 13 19:14:06.178786 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.178670    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"default-dockercfg-ghk5g\""
Jul 13 19:14:06.179802 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.179785    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"kube-root-ca.crt\""
Jul 13 19:14:06.179919 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.179896    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"auth-test-model-e91902-kserve-self-signed-certs\""
Jul 13 19:14:06.184941 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.184919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"]
Jul 13 19:14:06.254907 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.254870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-model-cache\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.254907 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.254907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tmp-dir\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.255120 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.254936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-home\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.255120 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.254951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tls-certs\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.255120 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.255003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-dshm\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.255120 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.255058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n99zp\" (UniqueName: \"kubernetes.io/projected/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-kube-api-access-n99zp\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.356565 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.356531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-home\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.356565 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.356566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tls-certs\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.356819 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.356588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-dshm\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.356819 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.356620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n99zp\" (UniqueName: \"kubernetes.io/projected/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-kube-api-access-n99zp\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.356819 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.356694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-model-cache\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.356819 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.356709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tmp-dir\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.357029 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.356974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-home\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.357029 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.357014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-model-cache\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.357112 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.357088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tmp-dir\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.359052 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.359029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-dshm\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.359223 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.359205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tls-certs\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.364911 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.364874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n99zp\" (UniqueName: \"kubernetes.io/projected/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-kube-api-access-n99zp\") pod \"auth-test-model-e91902-kserve-cb9b95595-4ktvm\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") " pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.484254 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.484169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:06.622460 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:06.622430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"]
Jul 13 19:14:06.625122 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:14:06.625096    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82dcd7a8_3311_47f0_b5e4_629cb6c3ec61.slice/crio-3f15bdffd0e5e3f2ba9678697240f33721a8f580328561d55bade3994c9788ee WatchSource:0}: Error finding container 3f15bdffd0e5e3f2ba9678697240f33721a8f580328561d55bade3994c9788ee: Status 404 returned error can't find the container with id 3f15bdffd0e5e3f2ba9678697240f33721a8f580328561d55bade3994c9788ee
Jul 13 19:14:07.147563 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:07.147522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm" event={"ID":"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61","Type":"ContainerStarted","Data":"59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b"}
Jul 13 19:14:07.147742 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:07.147573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm" event={"ID":"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61","Type":"ContainerStarted","Data":"3f15bdffd0e5e3f2ba9678697240f33721a8f580328561d55bade3994c9788ee"}
Jul 13 19:14:07.166717 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:07.166671    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm" podStartSLOduration=1.166657018 podStartE2EDuration="1.166657018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:14:07.165649783 +0000 UTC m=+2534.252755249" watchObservedRunningTime="2026-07-13 19:14:07.166657018 +0000 UTC m=+2534.253762482"
Jul 13 19:14:16.484812 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:16.484772    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:16.485319 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:16.484831    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:16.497955 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:16.497928    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:14:17.209027 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:14:17.208991    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:16:16.534902 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:16.534870    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"]
Jul 13 19:16:31.555753 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.555687    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm" podUID="82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" containerName="main" containerID="cri-o://59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b" gracePeriod=45
Jul 13 19:16:31.809374 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.809319    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:16:31.851570 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.851536    2565 generic.go:356] "Generic (PLEG): container finished" podID="82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" containerID="59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b" exitCode=0
Jul 13 19:16:31.851710 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.851570    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"
Jul 13 19:16:31.851710 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.851582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm" event={"ID":"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61","Type":"ContainerDied","Data":"59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b"}
Jul 13 19:16:31.851710 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.851622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm" event={"ID":"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61","Type":"ContainerDied","Data":"3f15bdffd0e5e3f2ba9678697240f33721a8f580328561d55bade3994c9788ee"}
Jul 13 19:16:31.851710 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.851644    2565 scope.go:117] "RemoveContainer" containerID="59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b"
Jul 13 19:16:31.860200 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.860184    2565 scope.go:117] "RemoveContainer" containerID="59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b"
Jul 13 19:16:31.860482 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:16:31.860436    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b\": container with ID starting with 59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b not found: ID does not exist" containerID="59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b"
Jul 13 19:16:31.860593 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.860495    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b"} err="failed to get container status \"59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b\": rpc error: code = NotFound desc = could not find container \"59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b\": container with ID starting with 59cdecf847402f7b0952b01a2af75c6f458daa891cb63343c4f4c36f13db4e4b not found: ID does not exist"
Jul 13 19:16:31.892142 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892119    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tmp-dir\") pod \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") "
Jul 13 19:16:31.892281 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n99zp\" (UniqueName: \"kubernetes.io/projected/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-kube-api-access-n99zp\") pod \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") "
Jul 13 19:16:31.892281 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892227    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-model-cache\") pod \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") "
Jul 13 19:16:31.892281 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892277    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tls-certs\") pod \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") "
Jul 13 19:16:31.892421 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892345    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-home\") pod \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") "
Jul 13 19:16:31.892421 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892397    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-dshm\") pod \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\" (UID: \"82dcd7a8-3311-47f0-b5e4-629cb6c3ec61\") "
Jul 13 19:16:31.892421 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892405    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" (UID: "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:16:31.892614 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892577    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-model-cache" (OuterVolumeSpecName: "model-cache") pod "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" (UID: "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:16:31.892675 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892644    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-home" (OuterVolumeSpecName: "home") pod "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" (UID: "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:16:31.892725 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892711    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-home\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:16:31.892762 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892725    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tmp-dir\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:16:31.892762 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.892735    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-model-cache\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:16:31.894550 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.894527    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-kube-api-access-n99zp" (OuterVolumeSpecName: "kube-api-access-n99zp") pod "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" (UID: "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61"). InnerVolumeSpecName "kube-api-access-n99zp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:16:31.894643 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.894554    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-dshm" (OuterVolumeSpecName: "dshm") pod "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" (UID: "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:16:31.894749 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.894686    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" (UID: "82dcd7a8-3311-47f0-b5e4-629cb6c3ec61"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:16:31.993338 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.993305    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-tls-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:16:31.993338 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.993331    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-dshm\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:16:31.993338 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:31.993340    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n99zp\" (UniqueName: \"kubernetes.io/projected/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61-kube-api-access-n99zp\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:16:32.173827 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:32.173790    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"]
Jul 13 19:16:32.181853 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:32.181828    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/auth-test-model-e91902-kserve-cb9b95595-4ktvm"]
Jul 13 19:16:33.465951 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:33.465919    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" path="/var/lib/kubelet/pods/82dcd7a8-3311-47f0-b5e4-629cb6c3ec61/volumes"
Jul 13 19:16:44.974821 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.974726    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"]
Jul 13 19:16:44.975627 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.975598    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" containerName="main"
Jul 13 19:16:44.975627 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.975628    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" containerName="main"
Jul 13 19:16:44.975872 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.975855    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5eb69fa-c113-4374-b12e-5bade9ed22f6" containerName="revoke-keys"
Jul 13 19:16:44.975942 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.975890    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="82dcd7a8-3311-47f0-b5e4-629cb6c3ec61" containerName="main"
Jul 13 19:16:44.980956 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.980931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:44.985223 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.985198    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"sub-test-model-e91902-kserve-self-signed-certs\""
Jul 13 19:16:44.985367 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.985323    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"default-dockercfg-ghk5g\""
Jul 13 19:16:44.985442 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.985364    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"kube-root-ca.crt\""
Jul 13 19:16:44.985553 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.985530    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"openshift-service-ca.crt\""
Jul 13 19:16:44.987885 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:44.987861    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"]
Jul 13 19:16:45.116149 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.116113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-model-cache\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.116345 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.116161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-dshm\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.116345 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.116200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-tmp-dir\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.116345 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.116229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-home\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.116345 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.116245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d640a08e-762c-4478-a746-d13231daae47-tls-certs\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.116345 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.116310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fndhx\" (UniqueName: \"kubernetes.io/projected/d640a08e-762c-4478-a746-d13231daae47-kube-api-access-fndhx\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.216868 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.216835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-tmp-dir\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.216868 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.216872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-home\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.217111 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.216891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d640a08e-762c-4478-a746-d13231daae47-tls-certs\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.217111 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.216911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fndhx\" (UniqueName: \"kubernetes.io/projected/d640a08e-762c-4478-a746-d13231daae47-kube-api-access-fndhx\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.217111 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.216966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-model-cache\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.217111 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.216993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-dshm\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.217345 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.217319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-tmp-dir\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.217431 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.217333    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-home\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.217431 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.217383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-model-cache\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.219456 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.219438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-dshm\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.219874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.219853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d640a08e-762c-4478-a746-d13231daae47-tls-certs\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.228894 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.228839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fndhx\" (UniqueName: \"kubernetes.io/projected/d640a08e-762c-4478-a746-d13231daae47-kube-api-access-fndhx\") pod \"sub-test-model-e91902-kserve-76d55b47bc-lpc97\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") " pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.291535 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.291495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:45.440434 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.440408    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"]
Jul 13 19:16:45.442436 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:16:45.442412    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd640a08e_762c_4478_a746_d13231daae47.slice/crio-bc03d34a46a95993f0e9753d0a7d4821c1eaa79421fdba88c0b5d1ff401ae430 WatchSource:0}: Error finding container bc03d34a46a95993f0e9753d0a7d4821c1eaa79421fdba88c0b5d1ff401ae430: Status 404 returned error can't find the container with id bc03d34a46a95993f0e9753d0a7d4821c1eaa79421fdba88c0b5d1ff401ae430
Jul 13 19:16:45.920385 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.920348    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97" event={"ID":"d640a08e-762c-4478-a746-d13231daae47","Type":"ContainerStarted","Data":"9ba6d170d7c7accc6a8441622f31d8154fe9fd030cb83e2f9e1f6eabc6a49b66"}
Jul 13 19:16:45.920576 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.920391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97" event={"ID":"d640a08e-762c-4478-a746-d13231daae47","Type":"ContainerStarted","Data":"bc03d34a46a95993f0e9753d0a7d4821c1eaa79421fdba88c0b5d1ff401ae430"}
Jul 13 19:16:45.939079 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:45.939027    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97" podStartSLOduration=1.939011761 podStartE2EDuration="1.939011761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:16:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:16:45.937792463 +0000 UTC m=+2693.024897952" watchObservedRunningTime="2026-07-13 19:16:45.939011761 +0000 UTC m=+2693.026117228"
Jul 13 19:16:53.514970 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:53.514933    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 19:16:53.520061 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:53.520037    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 19:16:53.521608 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:53.521589    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 19:16:53.526585 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:53.526567    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2g87g_8e77e4a1-54ab-4c49-9460-8f5fa06f2b5f/ovn-acl-logging/0.log"
Jul 13 19:16:55.291804 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:55.291750    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:55.292211 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:55.291825    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:55.304589 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:55.304563    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:16:55.985071 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:16:55.985024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:17:20.979980 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:20.979941    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"]
Jul 13 19:17:36.002144 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.002087    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97" podUID="d640a08e-762c-4478-a746-d13231daae47" containerName="main" containerID="cri-o://9ba6d170d7c7accc6a8441622f31d8154fe9fd030cb83e2f9e1f6eabc6a49b66" gracePeriod=45
Jul 13 19:17:36.165096 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.165065    2565 generic.go:356] "Generic (PLEG): container finished" podID="d640a08e-762c-4478-a746-d13231daae47" containerID="9ba6d170d7c7accc6a8441622f31d8154fe9fd030cb83e2f9e1f6eabc6a49b66" exitCode=0
Jul 13 19:17:36.165261 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.165103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97" event={"ID":"d640a08e-762c-4478-a746-d13231daae47","Type":"ContainerDied","Data":"9ba6d170d7c7accc6a8441622f31d8154fe9fd030cb83e2f9e1f6eabc6a49b66"}
Jul 13 19:17:36.258205 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.258145    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:17:36.288749 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.288719    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fndhx\" (UniqueName: \"kubernetes.io/projected/d640a08e-762c-4478-a746-d13231daae47-kube-api-access-fndhx\") pod \"d640a08e-762c-4478-a746-d13231daae47\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") "
Jul 13 19:17:36.288749 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.288754    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-home\") pod \"d640a08e-762c-4478-a746-d13231daae47\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") "
Jul 13 19:17:36.288972 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.288813    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-tmp-dir\") pod \"d640a08e-762c-4478-a746-d13231daae47\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") "
Jul 13 19:17:36.288972 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.288870    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d640a08e-762c-4478-a746-d13231daae47-tls-certs\") pod \"d640a08e-762c-4478-a746-d13231daae47\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") "
Jul 13 19:17:36.288972 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.288892    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-model-cache\") pod \"d640a08e-762c-4478-a746-d13231daae47\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") "
Jul 13 19:17:36.288972 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.288926    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-dshm\") pod \"d640a08e-762c-4478-a746-d13231daae47\" (UID: \"d640a08e-762c-4478-a746-d13231daae47\") "
Jul 13 19:17:36.289189 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.289076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-home" (OuterVolumeSpecName: "home") pod "d640a08e-762c-4478-a746-d13231daae47" (UID: "d640a08e-762c-4478-a746-d13231daae47"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:17:36.289189 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.289123    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d640a08e-762c-4478-a746-d13231daae47" (UID: "d640a08e-762c-4478-a746-d13231daae47"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:17:36.289351 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.289305    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-tmp-dir\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:17:36.289351 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.289333    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-home\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:17:36.289351 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.289308    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-model-cache" (OuterVolumeSpecName: "model-cache") pod "d640a08e-762c-4478-a746-d13231daae47" (UID: "d640a08e-762c-4478-a746-d13231daae47"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:17:36.291759 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.291717    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d640a08e-762c-4478-a746-d13231daae47-kube-api-access-fndhx" (OuterVolumeSpecName: "kube-api-access-fndhx") pod "d640a08e-762c-4478-a746-d13231daae47" (UID: "d640a08e-762c-4478-a746-d13231daae47"). InnerVolumeSpecName "kube-api-access-fndhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:17:36.291891 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.291824    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-dshm" (OuterVolumeSpecName: "dshm") pod "d640a08e-762c-4478-a746-d13231daae47" (UID: "d640a08e-762c-4478-a746-d13231daae47"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:17:36.291891 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.291826    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d640a08e-762c-4478-a746-d13231daae47-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d640a08e-762c-4478-a746-d13231daae47" (UID: "d640a08e-762c-4478-a746-d13231daae47"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:17:36.390008 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.389973    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d640a08e-762c-4478-a746-d13231daae47-tls-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:17:36.390008 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.390002    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-model-cache\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:17:36.390008 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.390011    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d640a08e-762c-4478-a746-d13231daae47-dshm\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:17:36.390247 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:36.390021    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fndhx\" (UniqueName: \"kubernetes.io/projected/d640a08e-762c-4478-a746-d13231daae47-kube-api-access-fndhx\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:17:37.171460 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:37.171428    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"
Jul 13 19:17:37.171933 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:37.171488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97" event={"ID":"d640a08e-762c-4478-a746-d13231daae47","Type":"ContainerDied","Data":"bc03d34a46a95993f0e9753d0a7d4821c1eaa79421fdba88c0b5d1ff401ae430"}
Jul 13 19:17:37.171933 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:37.171548    2565 scope.go:117] "RemoveContainer" containerID="9ba6d170d7c7accc6a8441622f31d8154fe9fd030cb83e2f9e1f6eabc6a49b66"
Jul 13 19:17:37.193340 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:37.193305    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"]
Jul 13 19:17:37.197386 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:37.197358    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/sub-test-model-e91902-kserve-76d55b47bc-lpc97"]
Jul 13 19:17:37.466593 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:37.466505    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d640a08e-762c-4478-a746-d13231daae47" path="/var/lib/kubelet/pods/d640a08e-762c-4478-a746-d13231daae47/volumes"
Jul 13 19:17:58.461000 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.460966    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"]
Jul 13 19:17:58.461461 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.461329    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d640a08e-762c-4478-a746-d13231daae47" containerName="main"
Jul 13 19:17:58.461461 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.461341    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d640a08e-762c-4478-a746-d13231daae47" containerName="main"
Jul 13 19:17:58.461461 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.461402    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d640a08e-762c-4478-a746-d13231daae47" containerName="main"
Jul 13 19:17:58.465813 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.465796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.468708 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.468681    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"openshift-service-ca.crt\""
Jul 13 19:17:58.468830 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.468814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"rate-test-model-e91902-kserve-self-signed-certs\""
Jul 13 19:17:58.469726 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.469706    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"default-dockercfg-ghk5g\""
Jul 13 19:17:58.469783 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.469709    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e91902\"/\"kube-root-ca.crt\""
Jul 13 19:17:58.473995 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.473975    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"]
Jul 13 19:17:58.581787 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.581751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-tmp-dir\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.581980 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.581841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5t76\" (UniqueName: \"kubernetes.io/projected/36574533-8cc3-4df6-b98d-6de45329ce0a-kube-api-access-g5t76\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.581980 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.581869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36574533-8cc3-4df6-b98d-6de45329ce0a-tls-certs\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.581980 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.581896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-home\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.581980 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.581970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-model-cache\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.582145 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.581999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-dshm\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.682865 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.682820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-model-cache\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.683069 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.682875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-dshm\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.683069 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.682921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-tmp-dir\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.683069 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.682966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5t76\" (UniqueName: \"kubernetes.io/projected/36574533-8cc3-4df6-b98d-6de45329ce0a-kube-api-access-g5t76\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.683069 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.682993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36574533-8cc3-4df6-b98d-6de45329ce0a-tls-certs\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.683069 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.683018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-home\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.683401 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.683332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-model-cache\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.683401 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.683376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-tmp-dir\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.683554 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.683450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-home\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.685454 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.685426    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-dshm\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.685609 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.685594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36574533-8cc3-4df6-b98d-6de45329ce0a-tls-certs\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.691370 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.691349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5t76\" (UniqueName: \"kubernetes.io/projected/36574533-8cc3-4df6-b98d-6de45329ce0a-kube-api-access-g5t76\") pod \"rate-test-model-e91902-kserve-77bddf6f9-m7ppd\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") " pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.775843 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.775748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:17:58.924852 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:58.924825    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"]
Jul 13 19:17:58.926783 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:17:58.926753    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36574533_8cc3_4df6_b98d_6de45329ce0a.slice/crio-0b6bb4be636cb2a22e62c8d00d44c8b2c170d0d44becd3f7ccb882c93a1793e2 WatchSource:0}: Error finding container 0b6bb4be636cb2a22e62c8d00d44c8b2c170d0d44becd3f7ccb882c93a1793e2: Status 404 returned error can't find the container with id 0b6bb4be636cb2a22e62c8d00d44c8b2c170d0d44becd3f7ccb882c93a1793e2
Jul 13 19:17:59.277574 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:59.277532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd" event={"ID":"36574533-8cc3-4df6-b98d-6de45329ce0a","Type":"ContainerStarted","Data":"ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b"}
Jul 13 19:17:59.277762 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:59.277585    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd" event={"ID":"36574533-8cc3-4df6-b98d-6de45329ce0a","Type":"ContainerStarted","Data":"0b6bb4be636cb2a22e62c8d00d44c8b2c170d0d44becd3f7ccb882c93a1793e2"}
Jul 13 19:17:59.296776 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:17:59.296724    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd" podStartSLOduration=1.296708454 podStartE2EDuration="1.296708454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:17:59.295033439 +0000 UTC m=+2766.382138903" watchObservedRunningTime="2026-07-13 19:17:59.296708454 +0000 UTC m=+2766.383813918"
Jul 13 19:18:08.775982 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:18:08.775931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:18:08.775982 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:18:08.775993    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:18:08.789059 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:18:08.789038    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:18:09.337940 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:18:09.337912    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:18:46.178906 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:18:46.178871    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"]
Jul 13 19:19:01.204109 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.204051    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd" podUID="36574533-8cc3-4df6-b98d-6de45329ce0a" containerName="main" containerID="cri-o://ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b" gracePeriod=45
Jul 13 19:19:01.451203 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.451177    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:19:01.556090 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.555984    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-model-cache\") pod \"36574533-8cc3-4df6-b98d-6de45329ce0a\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") "
Jul 13 19:19:01.556090 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.556098    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36574533-8cc3-4df6-b98d-6de45329ce0a-tls-certs\") pod \"36574533-8cc3-4df6-b98d-6de45329ce0a\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") "
Jul 13 19:19:01.556346 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.556158    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-dshm\") pod \"36574533-8cc3-4df6-b98d-6de45329ce0a\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") "
Jul 13 19:19:01.556346 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.556176    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-home\") pod \"36574533-8cc3-4df6-b98d-6de45329ce0a\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") "
Jul 13 19:19:01.556346 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.556212    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-tmp-dir\") pod \"36574533-8cc3-4df6-b98d-6de45329ce0a\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") "
Jul 13 19:19:01.556346 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.556229    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5t76\" (UniqueName: \"kubernetes.io/projected/36574533-8cc3-4df6-b98d-6de45329ce0a-kube-api-access-g5t76\") pod \"36574533-8cc3-4df6-b98d-6de45329ce0a\" (UID: \"36574533-8cc3-4df6-b98d-6de45329ce0a\") "
Jul 13 19:19:01.556346 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.556258    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-model-cache" (OuterVolumeSpecName: "model-cache") pod "36574533-8cc3-4df6-b98d-6de45329ce0a" (UID: "36574533-8cc3-4df6-b98d-6de45329ce0a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:19:01.556632 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.556512    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36574533-8cc3-4df6-b98d-6de45329ce0a" (UID: "36574533-8cc3-4df6-b98d-6de45329ce0a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:19:01.556632 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.556533    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-home" (OuterVolumeSpecName: "home") pod "36574533-8cc3-4df6-b98d-6de45329ce0a" (UID: "36574533-8cc3-4df6-b98d-6de45329ce0a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:19:01.556632 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.556559    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-model-cache\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:19:01.558444 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.558415    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36574533-8cc3-4df6-b98d-6de45329ce0a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36574533-8cc3-4df6-b98d-6de45329ce0a" (UID: "36574533-8cc3-4df6-b98d-6de45329ce0a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:19:01.558575 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.558487    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-dshm" (OuterVolumeSpecName: "dshm") pod "36574533-8cc3-4df6-b98d-6de45329ce0a" (UID: "36574533-8cc3-4df6-b98d-6de45329ce0a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:19:01.558575 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.558493    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36574533-8cc3-4df6-b98d-6de45329ce0a-kube-api-access-g5t76" (OuterVolumeSpecName: "kube-api-access-g5t76") pod "36574533-8cc3-4df6-b98d-6de45329ce0a" (UID: "36574533-8cc3-4df6-b98d-6de45329ce0a"). InnerVolumeSpecName "kube-api-access-g5t76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:19:01.575321 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.575287    2565 generic.go:356] "Generic (PLEG): container finished" podID="36574533-8cc3-4df6-b98d-6de45329ce0a" containerID="ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b" exitCode=0
Jul 13 19:19:01.575534 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.575353    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd" event={"ID":"36574533-8cc3-4df6-b98d-6de45329ce0a","Type":"ContainerDied","Data":"ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b"}
Jul 13 19:19:01.575534 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.575394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd" event={"ID":"36574533-8cc3-4df6-b98d-6de45329ce0a","Type":"ContainerDied","Data":"0b6bb4be636cb2a22e62c8d00d44c8b2c170d0d44becd3f7ccb882c93a1793e2"}
Jul 13 19:19:01.575534 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.575405    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"
Jul 13 19:19:01.575534 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.575416    2565 scope.go:117] "RemoveContainer" containerID="ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b"
Jul 13 19:19:01.588738 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.588717    2565 scope.go:117] "RemoveContainer" containerID="ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b"
Jul 13 19:19:01.589049 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:19:01.589031    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b\": container with ID starting with ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b not found: ID does not exist" containerID="ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b"
Jul 13 19:19:01.589092 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.589058    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b"} err="failed to get container status \"ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b\": rpc error: code = NotFound desc = could not find container \"ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b\": container with ID starting with ab6edeab9c75addde7fbfadfea6858d4c9ccdca487257f47092f11cd15d3288b not found: ID does not exist"
Jul 13 19:19:01.601361 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.601329    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"]
Jul 13 19:19:01.603411 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.603386    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e91902/rate-test-model-e91902-kserve-77bddf6f9-m7ppd"]
Jul 13 19:19:01.657877 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.657822    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36574533-8cc3-4df6-b98d-6de45329ce0a-tls-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:19:01.657877 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.657869    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-dshm\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:19:01.657877 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.657876    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-home\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:19:01.657877 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.657885    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36574533-8cc3-4df6-b98d-6de45329ce0a-tmp-dir\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:19:01.657877 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:01.657893    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5t76\" (UniqueName: \"kubernetes.io/projected/36574533-8cc3-4df6-b98d-6de45329ce0a-kube-api-access-g5t76\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:19:03.467202 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:03.467164    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36574533-8cc3-4df6-b98d-6de45329ce0a" path="/var/lib/kubelet/pods/36574533-8cc3-4df6-b98d-6de45329ce0a/volumes"
Jul 13 19:19:05.113881 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.113847    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd"]
Jul 13 19:19:05.114251 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.114191    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36574533-8cc3-4df6-b98d-6de45329ce0a" containerName="main"
Jul 13 19:19:05.114251 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.114201    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="36574533-8cc3-4df6-b98d-6de45329ce0a" containerName="main"
Jul 13 19:19:05.114322 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.114271    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="36574533-8cc3-4df6-b98d-6de45329ce0a" containerName="main"
Jul 13 19:19:05.117250 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.117233    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd"
Jul 13 19:19:05.120003 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.119981    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 19:19:05.120149 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.120068    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lkrf8\""
Jul 13 19:19:05.126772 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.126748    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd"]
Jul 13 19:19:05.287804 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.287772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03dd9eab-bd8d-4853-b5aa-33064696721d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd\" (UID: \"03dd9eab-bd8d-4853-b5aa-33064696721d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd"
Jul 13 19:19:05.388948 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.388792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03dd9eab-bd8d-4853-b5aa-33064696721d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd\" (UID: \"03dd9eab-bd8d-4853-b5aa-33064696721d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd"
Jul 13 19:19:05.389414 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.389386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03dd9eab-bd8d-4853-b5aa-33064696721d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd\" (UID: \"03dd9eab-bd8d-4853-b5aa-33064696721d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd"
Jul 13 19:19:05.428234 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.428208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd"
Jul 13 19:19:05.563511 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.563485    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd"]
Jul 13 19:19:05.565457 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:19:05.565430    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03dd9eab_bd8d_4853_b5aa_33064696721d.slice/crio-6910bd1ad1268c99e4deda57c16ed759d2f0a8ced3f47ca8aea8d964fe70a735 WatchSource:0}: Error finding container 6910bd1ad1268c99e4deda57c16ed759d2f0a8ced3f47ca8aea8d964fe70a735: Status 404 returned error can't find the container with id 6910bd1ad1268c99e4deda57c16ed759d2f0a8ced3f47ca8aea8d964fe70a735
Jul 13 19:19:05.595845 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:05.595821    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd" event={"ID":"03dd9eab-bd8d-4853-b5aa-33064696721d","Type":"ContainerStarted","Data":"6910bd1ad1268c99e4deda57c16ed759d2f0a8ced3f47ca8aea8d964fe70a735"}
Jul 13 19:19:06.602261 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:06.602226    2565 generic.go:356] "Generic (PLEG): container finished" podID="03dd9eab-bd8d-4853-b5aa-33064696721d" containerID="39fb85995cc1cce542e750393d7a4916197b541f3029f98f4f61682b0d4aafeb" exitCode=0
Jul 13 19:19:06.602688 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:06.602282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd" event={"ID":"03dd9eab-bd8d-4853-b5aa-33064696721d","Type":"ContainerDied","Data":"39fb85995cc1cce542e750393d7a4916197b541f3029f98f4f61682b0d4aafeb"}
Jul 13 19:19:07.745453 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:07.739934    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd"
Jul 13 19:19:07.911446 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:07.911410    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03dd9eab-bd8d-4853-b5aa-33064696721d-maas-api-service-ca\") pod \"03dd9eab-bd8d-4853-b5aa-33064696721d\" (UID: \"03dd9eab-bd8d-4853-b5aa-33064696721d\") "
Jul 13 19:19:07.911848 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:07.911824    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03dd9eab-bd8d-4853-b5aa-33064696721d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "03dd9eab-bd8d-4853-b5aa-33064696721d" (UID: "03dd9eab-bd8d-4853-b5aa-33064696721d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:19:08.012833 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:08.012785    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03dd9eab-bd8d-4853-b5aa-33064696721d-maas-api-service-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:19:08.613535 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:08.613503    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd"
Jul 13 19:19:08.613728 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:08.613530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd" event={"ID":"03dd9eab-bd8d-4853-b5aa-33064696721d","Type":"ContainerDied","Data":"6910bd1ad1268c99e4deda57c16ed759d2f0a8ced3f47ca8aea8d964fe70a735"}
Jul 13 19:19:08.613728 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:08.613592    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6910bd1ad1268c99e4deda57c16ed759d2f0a8ced3f47ca8aea8d964fe70a735"
Jul 13 19:19:32.591680 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.591642    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"]
Jul 13 19:19:32.592138 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.592005    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03dd9eab-bd8d-4853-b5aa-33064696721d" containerName="revoke-keys"
Jul 13 19:19:32.592138 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.592015    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="03dd9eab-bd8d-4853-b5aa-33064696721d" containerName="revoke-keys"
Jul 13 19:19:32.592138 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.592079    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="03dd9eab-bd8d-4853-b5aa-33064696721d" containerName="revoke-keys"
Jul 13 19:19:32.595090 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.595074    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"
Jul 13 19:19:32.598183 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.598156    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 19:19:32.598304 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.598192    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lkrf8\""
Jul 13 19:19:32.604514 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.604492    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"]
Jul 13 19:19:32.624052 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.624023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b641df4-721f-4524-af92-d4008341fcd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-78327326-d4svk\" (UID: \"3b641df4-721f-4524-af92-d4008341fcd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"
Jul 13 19:19:32.725521 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.725463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b641df4-721f-4524-af92-d4008341fcd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-78327326-d4svk\" (UID: \"3b641df4-721f-4524-af92-d4008341fcd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"
Jul 13 19:19:32.726146 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.726128    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b641df4-721f-4524-af92-d4008341fcd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-78327326-d4svk\" (UID: \"3b641df4-721f-4524-af92-d4008341fcd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"
Jul 13 19:19:32.906032 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:32.905998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"
Jul 13 19:19:33.254918 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:33.254896    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"]
Jul 13 19:19:33.257160 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:19:33.257134    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b641df4_721f_4524_af92_d4008341fcd1.slice/crio-ffb9bdcc72f65ee7d717275149b4a703560074014e1ab4d0f9942b1738c98dac WatchSource:0}: Error finding container ffb9bdcc72f65ee7d717275149b4a703560074014e1ab4d0f9942b1738c98dac: Status 404 returned error can't find the container with id ffb9bdcc72f65ee7d717275149b4a703560074014e1ab4d0f9942b1738c98dac
Jul 13 19:19:33.731037 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:33.731000    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" event={"ID":"3b641df4-721f-4524-af92-d4008341fcd1","Type":"ContainerStarted","Data":"a22411c0a9ff1cc89c750158142004d6560692ca9849977e5b48253dfc5d236c"}
Jul 13 19:19:33.731424 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:33.731056    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" event={"ID":"3b641df4-721f-4524-af92-d4008341fcd1","Type":"ContainerStarted","Data":"ffb9bdcc72f65ee7d717275149b4a703560074014e1ab4d0f9942b1738c98dac"}
Jul 13 19:19:33.749417 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:33.749366    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" podStartSLOduration=1.7493459900000001 podStartE2EDuration="1.74934599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:19:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:19:33.747412479 +0000 UTC m=+2860.834517956" watchObservedRunningTime="2026-07-13 19:19:33.74934599 +0000 UTC m=+2860.836451456"
Jul 13 19:19:34.737157 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:34.737120    2565 generic.go:356] "Generic (PLEG): container finished" podID="3b641df4-721f-4524-af92-d4008341fcd1" containerID="a22411c0a9ff1cc89c750158142004d6560692ca9849977e5b48253dfc5d236c" exitCode=6
Jul 13 19:19:34.737602 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:34.737194    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" event={"ID":"3b641df4-721f-4524-af92-d4008341fcd1","Type":"ContainerDied","Data":"a22411c0a9ff1cc89c750158142004d6560692ca9849977e5b48253dfc5d236c"}
Jul 13 19:19:34.737602 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:34.737409    2565 scope.go:117] "RemoveContainer" containerID="a22411c0a9ff1cc89c750158142004d6560692ca9849977e5b48253dfc5d236c"
Jul 13 19:19:35.743578 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:35.743543    2565 generic.go:356] "Generic (PLEG): container finished" podID="3b641df4-721f-4524-af92-d4008341fcd1" containerID="c829ed67ca26fbd85e2ba3fa9e4211cca915d5000ebb7642349d91e3a391c885" exitCode=6
Jul 13 19:19:35.744038 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:35.743635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" event={"ID":"3b641df4-721f-4524-af92-d4008341fcd1","Type":"ContainerDied","Data":"c829ed67ca26fbd85e2ba3fa9e4211cca915d5000ebb7642349d91e3a391c885"}
Jul 13 19:19:35.744038 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:35.743696    2565 scope.go:117] "RemoveContainer" containerID="a22411c0a9ff1cc89c750158142004d6560692ca9849977e5b48253dfc5d236c"
Jul 13 19:19:35.744038 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:35.743892    2565 scope.go:117] "RemoveContainer" containerID="c829ed67ca26fbd85e2ba3fa9e4211cca915d5000ebb7642349d91e3a391c885"
Jul 13 19:19:35.744169 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:19:35.744122    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-78327326-d4svk_odh-ai-gateway-infra(3b641df4-721f-4524-af92-d4008341fcd1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" podUID="3b641df4-721f-4524-af92-d4008341fcd1"
Jul 13 19:19:36.749727 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:36.749695    2565 scope.go:117] "RemoveContainer" containerID="c829ed67ca26fbd85e2ba3fa9e4211cca915d5000ebb7642349d91e3a391c885"
Jul 13 19:19:36.750131 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:19:36.749910    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-78327326-d4svk_odh-ai-gateway-infra(3b641df4-721f-4524-af92-d4008341fcd1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" podUID="3b641df4-721f-4524-af92-d4008341fcd1"
Jul 13 19:19:51.460385 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:51.460359    2565 scope.go:117] "RemoveContainer" containerID="c829ed67ca26fbd85e2ba3fa9e4211cca915d5000ebb7642349d91e3a391c885"
Jul 13 19:19:51.824135 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:51.824104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" event={"ID":"3b641df4-721f-4524-af92-d4008341fcd1","Type":"ContainerStarted","Data":"c547e29616c3770f9fa71096422f9accbae281c3bef463e043d102e70f6d8d38"}
Jul 13 19:19:52.830420 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:52.830388    2565 generic.go:356] "Generic (PLEG): container finished" podID="3b641df4-721f-4524-af92-d4008341fcd1" containerID="c547e29616c3770f9fa71096422f9accbae281c3bef463e043d102e70f6d8d38" exitCode=6
Jul 13 19:19:52.830874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:52.830426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" event={"ID":"3b641df4-721f-4524-af92-d4008341fcd1","Type":"ContainerDied","Data":"c547e29616c3770f9fa71096422f9accbae281c3bef463e043d102e70f6d8d38"}
Jul 13 19:19:52.830874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:52.830494    2565 scope.go:117] "RemoveContainer" containerID="c829ed67ca26fbd85e2ba3fa9e4211cca915d5000ebb7642349d91e3a391c885"
Jul 13 19:19:52.830874 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:52.830748    2565 scope.go:117] "RemoveContainer" containerID="c547e29616c3770f9fa71096422f9accbae281c3bef463e043d102e70f6d8d38"
Jul 13 19:19:52.831004 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:19:52.830951    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-78327326-d4svk_odh-ai-gateway-infra(3b641df4-721f-4524-af92-d4008341fcd1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" podUID="3b641df4-721f-4524-af92-d4008341fcd1"
Jul 13 19:19:52.859691 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:52.859658    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"]
Jul 13 19:19:53.982962 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:53.982935    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"
Jul 13 19:19:54.123083 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:54.123050    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b641df4-721f-4524-af92-d4008341fcd1-maas-api-service-ca\") pod \"3b641df4-721f-4524-af92-d4008341fcd1\" (UID: \"3b641df4-721f-4524-af92-d4008341fcd1\") "
Jul 13 19:19:54.123415 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:54.123391    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b641df4-721f-4524-af92-d4008341fcd1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3b641df4-721f-4524-af92-d4008341fcd1" (UID: "3b641df4-721f-4524-af92-d4008341fcd1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:19:54.224285 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:54.224188    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b641df4-721f-4524-af92-d4008341fcd1-maas-api-service-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:19:54.842560 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:54.842530    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"
Jul 13 19:19:54.842743 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:54.842561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk" event={"ID":"3b641df4-721f-4524-af92-d4008341fcd1","Type":"ContainerDied","Data":"ffb9bdcc72f65ee7d717275149b4a703560074014e1ab4d0f9942b1738c98dac"}
Jul 13 19:19:54.842743 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:54.842618    2565 scope.go:117] "RemoveContainer" containerID="c547e29616c3770f9fa71096422f9accbae281c3bef463e043d102e70f6d8d38"
Jul 13 19:19:54.866618 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:54.866590    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"]
Jul 13 19:19:54.872979 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:54.872961    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-78327326-d4svk"]
Jul 13 19:19:55.464962 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:55.464927    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b641df4-721f-4524-af92-d4008341fcd1" path="/var/lib/kubelet/pods/3b641df4-721f-4524-af92-d4008341fcd1/volumes"
Jul 13 19:19:57.110806 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:57.110772    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"]
Jul 13 19:19:57.111240 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:57.111026    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy" containerID="cri-o://05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32" gracePeriod=30
Jul 13 19:19:57.835762 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:57.835719    2565 patch_prober.go:28] interesting pod/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 19:19:57.835958 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:19:57.835807    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:20:02.365263 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.365234    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:20:02.502216 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502175    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-envoy\") pod \"75cfd725-5002-4974-9122-16fc143e4376\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") "
Jul 13 19:20:02.502216 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502218    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75cfd725-5002-4974-9122-16fc143e4376-istio-podinfo\") pod \"75cfd725-5002-4974-9122-16fc143e4376\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") "
Jul 13 19:20:02.502491 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502272    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-istio-token\") pod \"75cfd725-5002-4974-9122-16fc143e4376\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") "
Jul 13 19:20:02.502491 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502290    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75cfd725-5002-4974-9122-16fc143e4376-istiod-ca-cert\") pod \"75cfd725-5002-4974-9122-16fc143e4376\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") "
Jul 13 19:20:02.502491 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502307    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-credential-socket\") pod \"75cfd725-5002-4974-9122-16fc143e4376\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") "
Jul 13 19:20:02.502491 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502323    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-socket\") pod \"75cfd725-5002-4974-9122-16fc143e4376\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") "
Jul 13 19:20:02.502491 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502342    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-certs\") pod \"75cfd725-5002-4974-9122-16fc143e4376\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") "
Jul 13 19:20:02.502754 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502528    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjkr5\" (UniqueName: \"kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-kube-api-access-vjkr5\") pod \"75cfd725-5002-4974-9122-16fc143e4376\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") "
Jul 13 19:20:02.502754 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502567    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-data\") pod \"75cfd725-5002-4974-9122-16fc143e4376\" (UID: \"75cfd725-5002-4974-9122-16fc143e4376\") "
Jul 13 19:20:02.502754 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502699    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "75cfd725-5002-4974-9122-16fc143e4376" (UID: "75cfd725-5002-4974-9122-16fc143e4376"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:20:02.502754 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502712    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "75cfd725-5002-4974-9122-16fc143e4376" (UID: "75cfd725-5002-4974-9122-16fc143e4376"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:20:02.502754 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502730    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "75cfd725-5002-4974-9122-16fc143e4376" (UID: "75cfd725-5002-4974-9122-16fc143e4376"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:20:02.503000 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502973    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-credential-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:20:02.503000 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.502995    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-socket\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:20:02.503271 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.503010    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-workload-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:20:02.503271 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.503043    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75cfd725-5002-4974-9122-16fc143e4376-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "75cfd725-5002-4974-9122-16fc143e4376" (UID: "75cfd725-5002-4974-9122-16fc143e4376"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:20:02.503435 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.503413    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-data" (OuterVolumeSpecName: "istio-data") pod "75cfd725-5002-4974-9122-16fc143e4376" (UID: "75cfd725-5002-4974-9122-16fc143e4376"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:20:02.504805 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.504775    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "75cfd725-5002-4974-9122-16fc143e4376" (UID: "75cfd725-5002-4974-9122-16fc143e4376"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:20:02.504805 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.504795    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-kube-api-access-vjkr5" (OuterVolumeSpecName: "kube-api-access-vjkr5") pod "75cfd725-5002-4974-9122-16fc143e4376" (UID: "75cfd725-5002-4974-9122-16fc143e4376"). InnerVolumeSpecName "kube-api-access-vjkr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:20:02.505129 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.505108    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-istio-token" (OuterVolumeSpecName: "istio-token") pod "75cfd725-5002-4974-9122-16fc143e4376" (UID: "75cfd725-5002-4974-9122-16fc143e4376"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:20:02.505222 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.505141    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75cfd725-5002-4974-9122-16fc143e4376-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "75cfd725-5002-4974-9122-16fc143e4376" (UID: "75cfd725-5002-4974-9122-16fc143e4376"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:20:02.604348 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.604315    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjkr5\" (UniqueName: \"kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-kube-api-access-vjkr5\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:20:02.604348 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.604341    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-data\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:20:02.604348 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.604351    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75cfd725-5002-4974-9122-16fc143e4376-istio-envoy\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:20:02.604348 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.604359    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75cfd725-5002-4974-9122-16fc143e4376-istio-podinfo\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:20:02.604635 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.604367    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75cfd725-5002-4974-9122-16fc143e4376-istio-token\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:20:02.604635 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.604376    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75cfd725-5002-4974-9122-16fc143e4376-istiod-ca-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Jul 13 19:20:02.883601 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.883517    2565 generic.go:356] "Generic (PLEG): container finished" podID="75cfd725-5002-4974-9122-16fc143e4376" containerID="05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32" exitCode=0
Jul 13 19:20:02.883601 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.883573    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"
Jul 13 19:20:02.883777 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.883602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" event={"ID":"75cfd725-5002-4974-9122-16fc143e4376","Type":"ContainerDied","Data":"05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32"}
Jul 13 19:20:02.883777 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.883661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t" event={"ID":"75cfd725-5002-4974-9122-16fc143e4376","Type":"ContainerDied","Data":"da682b41ae7737554cccb498e0a41d3c64db6a7af1c9ebefd7a4d08c15ccfef6"}
Jul 13 19:20:02.883777 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.883684    2565 scope.go:117] "RemoveContainer" containerID="05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32"
Jul 13 19:20:02.893389 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.893367    2565 scope.go:117] "RemoveContainer" containerID="da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f"
Jul 13 19:20:02.901639 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.901619    2565 scope.go:117] "RemoveContainer" containerID="05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32"
Jul 13 19:20:02.901901 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:20:02.901881    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32\": container with ID starting with 05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32 not found: ID does not exist" containerID="05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32"
Jul 13 19:20:02.901952 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.901909    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32"} err="failed to get container status \"05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32\": rpc error: code = NotFound desc = could not find container \"05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32\": container with ID starting with 05ed0cbe05b3ec9b4c41107ddb304257052e84d07cde18b60e0530b0fe05ca32 not found: ID does not exist"
Jul 13 19:20:02.901952 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.901929    2565 scope.go:117] "RemoveContainer" containerID="da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f"
Jul 13 19:20:02.902169 ip-10-0-131-162 kubenswrapper[2565]: E0713 19:20:02.902149    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f\": container with ID starting with da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f not found: ID does not exist" containerID="da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f"
Jul 13 19:20:02.902222 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.902178    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f"} err="failed to get container status \"da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f\": rpc error: code = NotFound desc = could not find container \"da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f\": container with ID starting with da5b192a0d68ae275a75abdac44d29eec751d5b923a7ba94b77ff9438a76978f not found: ID does not exist"
Jul 13 19:20:02.906291 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.906269    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"]
Jul 13 19:20:02.913563 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:02.913544    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e91902-openshift-default-67b8ddb94c-2np4t"]
Jul 13 19:20:03.160611 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:03.160581    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d9b58f676-27h2f_2cc04771-072c-4a22-843f-d5ba14513903/manager/0.log"
Jul 13 19:20:03.465533 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:03.465422    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75cfd725-5002-4974-9122-16fc143e4376" path="/var/lib/kubelet/pods/75cfd725-5002-4974-9122-16fc143e4376/volumes"
Jul 13 19:20:03.512981 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:03.512950    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4789cfbf-p44nd_59d64478-93f5-4d2a-af24-de5bfd2e2cf6/manager/0.log"
Jul 13 19:20:03.519417 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:03.519399    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4789cfbf-p44nd_59d64478-93f5-4d2a-af24-de5bfd2e2cf6/copy-manifests/0.log"
Jul 13 19:20:05.066732 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:05.066701    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-695ca96e-5v4fm_763bcc3b-724c-4e1c-b695-12dd2545482b/revoke-keys/0.log"
Jul 13 19:20:05.646702 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:05.646669    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-7b883e-f72jd_03dd9eab-bd8d-4853-b5aa-33064696721d/revoke-keys/0.log"
Jul 13 19:20:07.638031 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:07.638002    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sc74n_0978beff-7740-45b1-b2e1-0df62797fc3a/registry-server/0.log"
Jul 13 19:20:07.783889 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:07.783862    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mkq5z_c6d3526e-ccb1-4129-a077-776c495edccd/manager/0.log"
Jul 13 19:20:08.021878 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:08.021834    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jfrb7_c67d1dd9-4750-4ce0-a7eb-f6ba384d8007/manager/0.log"
Jul 13 19:20:08.376644 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:08.376544    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cvtgm_310a469f-1c7f-41db-9676-3fd56f3a1fe8/istio-proxy/0.log"
Jul 13 19:20:08.870236 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:08.870199    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tn7vt_0aaabb14-a750-4734-bb78-2f49e6ac7e03/istio-proxy/1.log"
Jul 13 19:20:08.991399 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:08.991369    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-6kk7f_33578512-0e18-412b-8a92-5538d0f3ef31/payload-pre-processing/0.log"
Jul 13 19:20:09.108763 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:09.108734    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-jk4mh_6540f97b-7d13-4aeb-a82f-2dfb5da80940/payload-processing/0.log"
Jul 13 19:20:09.596722 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:09.596690    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-z7lcl_01f22cd9-a3de-4426-a970-4a268b8f4dbc/main/0.log"
Jul 13 19:20:09.946912 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:09.946885    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc68q6_8c78fbc3-ad9e-42a3-9817-39e3af8471f0/main/0.log"
Jul 13 19:20:10.176281 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:10.176248    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-dgvp9_b598a44b-6d98-456e-8f11-181649d4d87d/main/0.log"
Jul 13 19:20:14.714782 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.714748    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-msvxh/must-gather-rlvm8"]
Jul 13 19:20:14.715186 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715074    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b641df4-721f-4524-af92-d4008341fcd1" containerName="revoke-keys"
Jul 13 19:20:14.715186 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715084    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b641df4-721f-4524-af92-d4008341fcd1" containerName="revoke-keys"
Jul 13 19:20:14.715186 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715098    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy"
Jul 13 19:20:14.715186 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715104    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy"
Jul 13 19:20:14.715186 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715112    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy"
Jul 13 19:20:14.715186 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715117    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy"
Jul 13 19:20:14.715186 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715123    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b641df4-721f-4524-af92-d4008341fcd1" containerName="revoke-keys"
Jul 13 19:20:14.715186 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715128    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b641df4-721f-4524-af92-d4008341fcd1" containerName="revoke-keys"
Jul 13 19:20:14.715434 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715194    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b641df4-721f-4524-af92-d4008341fcd1" containerName="revoke-keys"
Jul 13 19:20:14.715434 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715201    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b641df4-721f-4524-af92-d4008341fcd1" containerName="revoke-keys"
Jul 13 19:20:14.715434 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715207    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy"
Jul 13 19:20:14.715434 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715259    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b641df4-721f-4524-af92-d4008341fcd1" containerName="revoke-keys"
Jul 13 19:20:14.715434 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715264    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b641df4-721f-4524-af92-d4008341fcd1" containerName="revoke-keys"
Jul 13 19:20:14.715434 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715323    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b641df4-721f-4524-af92-d4008341fcd1" containerName="revoke-keys"
Jul 13 19:20:14.715434 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.715330    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="75cfd725-5002-4974-9122-16fc143e4376" containerName="istio-proxy"
Jul 13 19:20:14.719930 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.719902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-msvxh/must-gather-rlvm8"
Jul 13 19:20:14.723487 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.723429    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-msvxh\"/\"openshift-service-ca.crt\""
Jul 13 19:20:14.723609 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.723516    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-msvxh\"/\"default-dockercfg-tkvs5\""
Jul 13 19:20:14.724402 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.724384    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-msvxh\"/\"kube-root-ca.crt\""
Jul 13 19:20:14.731975 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.731952    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-msvxh/must-gather-rlvm8"]
Jul 13 19:20:14.809200 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.809154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkzl\" (UniqueName: \"kubernetes.io/projected/f4d8a77d-e017-4098-94cd-6fa065244241-kube-api-access-dfkzl\") pod \"must-gather-rlvm8\" (UID: \"f4d8a77d-e017-4098-94cd-6fa065244241\") " pod="openshift-must-gather-msvxh/must-gather-rlvm8"
Jul 13 19:20:14.809388 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.809234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f4d8a77d-e017-4098-94cd-6fa065244241-must-gather-output\") pod \"must-gather-rlvm8\" (UID: \"f4d8a77d-e017-4098-94cd-6fa065244241\") " pod="openshift-must-gather-msvxh/must-gather-rlvm8"
Jul 13 19:20:14.909838 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.909802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f4d8a77d-e017-4098-94cd-6fa065244241-must-gather-output\") pod \"must-gather-rlvm8\" (UID: \"f4d8a77d-e017-4098-94cd-6fa065244241\") " pod="openshift-must-gather-msvxh/must-gather-rlvm8"
Jul 13 19:20:14.910005 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.909872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkzl\" (UniqueName: \"kubernetes.io/projected/f4d8a77d-e017-4098-94cd-6fa065244241-kube-api-access-dfkzl\") pod \"must-gather-rlvm8\" (UID: \"f4d8a77d-e017-4098-94cd-6fa065244241\") " pod="openshift-must-gather-msvxh/must-gather-rlvm8"
Jul 13 19:20:14.910159 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.910131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f4d8a77d-e017-4098-94cd-6fa065244241-must-gather-output\") pod \"must-gather-rlvm8\" (UID: \"f4d8a77d-e017-4098-94cd-6fa065244241\") " pod="openshift-must-gather-msvxh/must-gather-rlvm8"
Jul 13 19:20:14.924757 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:14.924733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkzl\" (UniqueName: \"kubernetes.io/projected/f4d8a77d-e017-4098-94cd-6fa065244241-kube-api-access-dfkzl\") pod \"must-gather-rlvm8\" (UID: \"f4d8a77d-e017-4098-94cd-6fa065244241\") " pod="openshift-must-gather-msvxh/must-gather-rlvm8"
Jul 13 19:20:15.029667 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:15.029574    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-msvxh/must-gather-rlvm8"
Jul 13 19:20:15.167505 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:15.167449    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-msvxh/must-gather-rlvm8"]
Jul 13 19:20:15.170592 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:20:15.170559    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4d8a77d_e017_4098_94cd_6fa065244241.slice/crio-432adf5bc67ea69f8e271e80bdcb5f2bc37aa91078f4519a0849b3f78e501fdd WatchSource:0}: Error finding container 432adf5bc67ea69f8e271e80bdcb5f2bc37aa91078f4519a0849b3f78e501fdd: Status 404 returned error can't find the container with id 432adf5bc67ea69f8e271e80bdcb5f2bc37aa91078f4519a0849b3f78e501fdd
Jul 13 19:20:15.172673 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:15.172649    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:20:15.946336 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:15.946306    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-msvxh/must-gather-rlvm8" event={"ID":"f4d8a77d-e017-4098-94cd-6fa065244241","Type":"ContainerStarted","Data":"432adf5bc67ea69f8e271e80bdcb5f2bc37aa91078f4519a0849b3f78e501fdd"}
Jul 13 19:20:16.954726 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:16.954691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-msvxh/must-gather-rlvm8" event={"ID":"f4d8a77d-e017-4098-94cd-6fa065244241","Type":"ContainerStarted","Data":"0eda6cea787f799783c6f3495b982575650aa941d093213c106591f94fc568e3"}
Jul 13 19:20:16.955220 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:16.954762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-msvxh/must-gather-rlvm8" event={"ID":"f4d8a77d-e017-4098-94cd-6fa065244241","Type":"ContainerStarted","Data":"f96dad844d17c5113e473b25e3fc94149107ecae6649eee15f4cb631d4fd9785"}
Jul 13 19:20:16.973225 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:16.973175    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-msvxh/must-gather-rlvm8" podStartSLOduration=2.256577246 podStartE2EDuration="2.973158725s" totalImagesPullingTime="716.581479ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:20:16.972833702 +0000 UTC m=+2904.059939168" watchObservedRunningTime="2026-07-13 19:20:16.973158725 +0000 UTC m=+2904.060264216"
Jul 13 19:20:17.459585 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:17.459556    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8gf7z_c58fee49-7c00-4083-ab69-fe0b779a3e5f/global-pull-secret-syncer/0.log"
Jul 13 19:20:17.674762 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:17.674731    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n4lzg_3effc6e2-75d5-468b-9ac9-f0f621a9b5a7/konnectivity-agent/0.log"
Jul 13 19:20:17.724567 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:17.724498    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-162.ec2.internal_8443562bfc49da3cf54d3bbbbd1082e0/haproxy/0.log"
Jul 13 19:20:21.911551 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:21.911510    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sc74n_0978beff-7740-45b1-b2e1-0df62797fc3a/registry-server/0.log"
Jul 13 19:20:22.070680 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:22.070642    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mkq5z_c6d3526e-ccb1-4129-a077-776c495edccd/manager/0.log"
Jul 13 19:20:22.181857 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:22.181774    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jfrb7_c67d1dd9-4750-4ce0-a7eb-f6ba384d8007/manager/0.log"
Jul 13 19:20:24.346851 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:24.346816    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tftqq_ff44152e-c4f5-44ff-b7f7-923a8e8babc2/node-exporter/0.log"
Jul 13 19:20:24.373749 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:24.373725    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tftqq_ff44152e-c4f5-44ff-b7f7-923a8e8babc2/kube-rbac-proxy/0.log"
Jul 13 19:20:24.400750 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:24.400709    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tftqq_ff44152e-c4f5-44ff-b7f7-923a8e8babc2/init-textfile/0.log"
Jul 13 19:20:26.749154 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:26.749117    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-g65jc_452e820d-e6a0-4182-acaf-26ac432d9bc9/networking-console-plugin/0.log"
Jul 13 19:20:27.376694 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:27.376656    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/2.log"
Jul 13 19:20:27.383598 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:27.383569    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2vnvh_904aa018-ac3c-4bff-bc2f-e8ec38db5ef1/console-operator/3.log"
Jul 13 19:20:27.806960 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:27.806922    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"]
Jul 13 19:20:27.813087 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:27.813060    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:27.820190 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:27.820158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"]
Jul 13 19:20:27.952854 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:27.952816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-podres\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:27.953101 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:27.952907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-lib-modules\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:27.953101 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:27.952940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-proc\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:27.953221 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:27.953095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctxks\" (UniqueName: \"kubernetes.io/projected/853094ba-63c0-472c-8249-9c0d0205bf46-kube-api-access-ctxks\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:27.953366 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:27.953345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-sys\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.054585 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.054542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctxks\" (UniqueName: \"kubernetes.io/projected/853094ba-63c0-472c-8249-9c0d0205bf46-kube-api-access-ctxks\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.054884 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.054863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-sys\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.055012 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.054998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-podres\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.055169 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.055146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-sys\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.055338 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.055148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-lib-modules\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.055509 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.055285    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-lib-modules\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.055598 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.055354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-podres\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.055659 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.055642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-proc\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.055730 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.055495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/853094ba-63c0-472c-8249-9c0d0205bf46-proc\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.064862 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.064765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctxks\" (UniqueName: \"kubernetes.io/projected/853094ba-63c0-472c-8249-9c0d0205bf46-kube-api-access-ctxks\") pod \"perf-node-gather-daemonset-fb7dv\" (UID: \"853094ba-63c0-472c-8249-9c0d0205bf46\") " pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.127182 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.127132    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:28.306863 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.306835    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"]
Jul 13 19:20:28.309490 ip-10-0-131-162 kubenswrapper[2565]: W0713 19:20:28.309439    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod853094ba_63c0_472c_8249_9c0d0205bf46.slice/crio-13e90f25e7a731ec6471782e629e991fc727efd4e4d8dce11083df46fe8b48b6 WatchSource:0}: Error finding container 13e90f25e7a731ec6471782e629e991fc727efd4e4d8dce11083df46fe8b48b6: Status 404 returned error can't find the container with id 13e90f25e7a731ec6471782e629e991fc727efd4e4d8dce11083df46fe8b48b6
Jul 13 19:20:28.679817 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:28.679785    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-h2flc_965ee80a-32e5-4786-9089-514f8d443857/volume-data-source-validator/0.log"
Jul 13 19:20:29.050565 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:29.050460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv" event={"ID":"853094ba-63c0-472c-8249-9c0d0205bf46","Type":"ContainerStarted","Data":"254e623cf7987dcdc582fcb16ff4544764fef3b22fca3aafa0586ce30b75df79"}
Jul 13 19:20:29.050565 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:29.050548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv" event={"ID":"853094ba-63c0-472c-8249-9c0d0205bf46","Type":"ContainerStarted","Data":"13e90f25e7a731ec6471782e629e991fc727efd4e4d8dce11083df46fe8b48b6"}
Jul 13 19:20:29.051020 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:29.050951    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:29.071150 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:29.071084    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv" podStartSLOduration=2.071064788 podStartE2EDuration="2.071064788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:20:29.068550491 +0000 UTC m=+2916.155655983" watchObservedRunningTime="2026-07-13 19:20:29.071064788 +0000 UTC m=+2916.158170258"
Jul 13 19:20:29.952386 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:29.952347    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vnb7d_478dd6b1-dc33-48b8-a5e7-a34a2039914b/dns/0.log"
Jul 13 19:20:29.980917 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:29.980888    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vnb7d_478dd6b1-dc33-48b8-a5e7-a34a2039914b/kube-rbac-proxy/0.log"
Jul 13 19:20:30.025852 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:30.025774    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7nm2p_a7d6e830-818a-4bd4-80d2-87ed399309df/dns-node-resolver/0.log"
Jul 13 19:20:30.767162 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:30.767136    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4f2sg_e96eecf0-f3c5-433f-ad85-222da1b718c5/node-ca/0.log"
Jul 13 19:20:31.908453 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:31.908423    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cvtgm_310a469f-1c7f-41db-9676-3fd56f3a1fe8/istio-proxy/0.log"
Jul 13 19:20:32.117091 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:32.117059    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tn7vt_0aaabb14-a750-4734-bb78-2f49e6ac7e03/istio-proxy/0.log"
Jul 13 19:20:32.148656 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:32.148626    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tn7vt_0aaabb14-a750-4734-bb78-2f49e6ac7e03/istio-proxy/1.log"
Jul 13 19:20:32.246902 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:32.246825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-6kk7f_33578512-0e18-412b-8a92-5538d0f3ef31/payload-pre-processing/0.log"
Jul 13 19:20:32.320796 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:32.320760    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-jk4mh_6540f97b-7d13-4aeb-a82f-2dfb5da80940/payload-processing/0.log"
Jul 13 19:20:33.113708 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:33.113672    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qfw8h_06562cd2-d027-4c32-8e76-8f7c5979a38f/serve-healthcheck-canary/0.log"
Jul 13 19:20:33.629580 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:33.629525    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-clkzx_db843a09-1042-4247-81c9-25bf59b3bb27/insights-operator/0.log"
Jul 13 19:20:33.630241 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:33.630207    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-clkzx_db843a09-1042-4247-81c9-25bf59b3bb27/insights-operator/1.log"
Jul 13 19:20:33.654417 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:33.654388    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqv54_642c3171-a34a-4331-b2fd-37e19ba3d385/kube-rbac-proxy/0.log"
Jul 13 19:20:33.677538 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:33.677506    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqv54_642c3171-a34a-4331-b2fd-37e19ba3d385/exporter/0.log"
Jul 13 19:20:33.700528 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:33.700501    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqv54_642c3171-a34a-4331-b2fd-37e19ba3d385/extractor/0.log"
Jul 13 19:20:35.069904 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:35.069867    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-msvxh/perf-node-gather-daemonset-fb7dv"
Jul 13 19:20:36.426699 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:36.426668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d9b58f676-27h2f_2cc04771-072c-4a22-843f-d5ba14513903/manager/0.log"
Jul 13 19:20:36.560689 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:36.560646    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4789cfbf-p44nd_59d64478-93f5-4d2a-af24-de5bfd2e2cf6/manager/0.log"
Jul 13 19:20:36.585329 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:36.585301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4789cfbf-p44nd_59d64478-93f5-4d2a-af24-de5bfd2e2cf6/copy-manifests/0.log"
Jul 13 19:20:38.008030 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:38.007998    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cvtgm_310a469f-1c7f-41db-9676-3fd56f3a1fe8/istio-proxy/0.log"
Jul 13 19:20:38.204349 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:38.204262    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tn7vt_0aaabb14-a750-4734-bb78-2f49e6ac7e03/istio-proxy/0.log"
Jul 13 19:20:38.208189 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:38.208152    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f7b869d75-rkl6d_19b68333-9e99-4f9f-95ce-6a232d2dc74f/manager/0.log"
Jul 13 19:20:38.239882 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:38.239856    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tn7vt_0aaabb14-a750-4734-bb78-2f49e6ac7e03/istio-proxy/1.log"
Jul 13 19:20:38.266146 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:38.266117    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-6kk7f_33578512-0e18-412b-8a92-5538d0f3ef31/payload-pre-processing/0.log"
Jul 13 19:20:38.295884 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:38.295855    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-jk4mh_6540f97b-7d13-4aeb-a82f-2dfb5da80940/payload-processing/0.log"
Jul 13 19:20:39.590156 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:39.590071    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cvtgm_310a469f-1c7f-41db-9676-3fd56f3a1fe8/istio-proxy/0.log"
Jul 13 19:20:39.762567 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:39.762534    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tn7vt_0aaabb14-a750-4734-bb78-2f49e6ac7e03/istio-proxy/0.log"
Jul 13 19:20:39.806320 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:39.806160    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tn7vt_0aaabb14-a750-4734-bb78-2f49e6ac7e03/istio-proxy/1.log"
Jul 13 19:20:39.829797 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:39.829766    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-6kk7f_33578512-0e18-412b-8a92-5538d0f3ef31/payload-pre-processing/0.log"
Jul 13 19:20:39.854428 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:39.854355    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-jk4mh_6540f97b-7d13-4aeb-a82f-2dfb5da80940/payload-processing/0.log"
Jul 13 19:20:43.375246 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:43.375207    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-tbnnd_52a903d7-0e86-4847-ae21-e255302e7dd7/migrator/0.log"
Jul 13 19:20:43.395422 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:43.395395    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-tbnnd_52a903d7-0e86-4847-ae21-e255302e7dd7/graceful-termination/0.log"
Jul 13 19:20:44.766996 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:44.766966    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5qqkl_21012000-8edd-4826-a3f2-6717605250e9/kube-multus/0.log"
Jul 13 19:20:44.793309 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:44.793275    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bk9s_be6726ef-f078-4798-9638-6d710a53c037/kube-multus-additional-cni-plugins/0.log"
Jul 13 19:20:44.813084 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:44.813057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bk9s_be6726ef-f078-4798-9638-6d710a53c037/egress-router-binary-copy/0.log"
Jul 13 19:20:44.832491 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:44.832446    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bk9s_be6726ef-f078-4798-9638-6d710a53c037/cni-plugins/0.log"
Jul 13 19:20:44.852098 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:44.852077    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bk9s_be6726ef-f078-4798-9638-6d710a53c037/bond-cni-plugin/0.log"
Jul 13 19:20:44.870338 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:44.870318    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bk9s_be6726ef-f078-4798-9638-6d710a53c037/routeoverride-cni/0.log"
Jul 13 19:20:44.890988 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:44.890964    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bk9s_be6726ef-f078-4798-9638-6d710a53c037/whereabouts-cni-bincopy/0.log"
Jul 13 19:20:44.910595 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:44.910572    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bk9s_be6726ef-f078-4798-9638-6d710a53c037/whereabouts-cni/0.log"
Jul 13 19:20:45.361758 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:45.361721    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jmmm5_b3e8e599-4106-42f0-97f1-a35fdf7afc9c/network-metrics-daemon/0.log"
Jul 13 19:20:45.380794 ip-10-0-131-162 kubenswrapper[2565]: I0713 19:20:45.380748    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jmmm5_b3e8e599-4106-42f0-97f1-a35fdf7afc9c/kube-rbac-proxy/0.log"