Jul 14 16:27:58.972582 ip-10-0-135-252 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 16:27:58.972594 ip-10-0-135-252 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 16:27:58.972601 ip-10-0-135-252 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 16:27:58.972924 ip-10-0-135-252 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 16:28:10.372452 ip-10-0-135-252 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 16:28:10.372468 ip-10-0-135-252 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b8ec1cfdc6b249fe8958c9ad4bf6ad43 -- Jul 14 16:30:09.046704 ip-10-0-135-252 systemd[1]: Starting Kubernetes Kubelet... Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.353234 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357745 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357758 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357763 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357766 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357769 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357772 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357775 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:30:09.444259 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357778 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:30:09.418062 ip-10-0-135-252 systemd[1]: Started Kubernetes Kubelet. Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357780 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357783 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357786 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357788 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357792 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357795 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357798 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357800 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357804 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357808 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357811 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357813 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357816 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357821 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357825 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357828 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357832 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357835 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:30:09.445486 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357839 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357841 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357844 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357846 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357849 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357852 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357855 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357857 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357861 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357864 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357867 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357870 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357874 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357877 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357879 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357882 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357885 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357888 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357891 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:30:09.447445 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357894 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357897 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357899 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357902 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357905 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357907 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357910 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357913 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357916 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357918 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357921 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357923 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357926 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357928 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357931 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357933 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357936 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357939 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357941 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357944 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:30:09.448134 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357946 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357949 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357951 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357954 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357957 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357959 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357963 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357965 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357968 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357970 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357973 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357975 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357978 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357981 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357984 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357987 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357990 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357993 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357995 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.357998 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:30:09.449987 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358001 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358003 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358006 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358009 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358012 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358015 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358017 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358020 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358023 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358026 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358028 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358030 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358033 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358036 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358791 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358798 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358801 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358804 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358807 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358811 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:30:09.451103 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358814 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358816 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358821 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358824 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358827 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358829 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358832 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358834 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358837 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358839 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358844 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358848 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358852 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358857 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358860 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358863 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358866 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358869 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358871 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:30:09.451843 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358874 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358877 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358879 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358882 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358886 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358889 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358892 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358895 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358898 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358901 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358904 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358906 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358909 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358916 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358919 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358922 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358925 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358928 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358931 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:30:09.452599 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358934 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358936 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358939 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358942 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358945 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358947 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358950 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358952 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358955 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358958 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358961 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358964 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358966 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358969 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358972 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358974 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358977 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358979 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358982 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358985 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:30:09.453306 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358987 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358990 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358992 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358995 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.358997 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359000 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359005 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359009 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359011 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359015 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359017 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359020 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359022 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359025 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359027 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359030 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359033 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359035 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359038 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359041 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:30:09.454049 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359043 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359046 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359048 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359050 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359053 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359055 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359058 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359060 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359063 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359066 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359068 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359071 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359073 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359076 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359079 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359521 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359527 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359532 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359537 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359547 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:30:09.454752 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359550 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359553 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359555 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359558 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359561 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359563 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359566 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359569 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359572 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359574 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359577 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359579 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359582 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359584 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359587 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359589 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359593 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359595 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359598 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359600 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:30:09.455485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359603 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359606 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359608 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359611 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359613 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359616 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359618 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359621 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359623 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359629 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359635 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359638 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359642 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359644 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359647 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359649 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359652 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359654 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359656 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359659 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:30:09.456240 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359661 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359664 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359666 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359669 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359672 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359674 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359677 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359680 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359682 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359685 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359688 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359692 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359695 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359698 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359700 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359703 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359705 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359708 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359710 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:30:09.457335 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359713 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359716 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359718 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359723 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359725 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359728 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359731 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359734 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359736 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359740 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359744 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359747 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359750 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359752 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359755 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359757 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359760 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359762 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359765 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359767 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:30:09.458102 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359769 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359772 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359774 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359777 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359780 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359783 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359786 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359788 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359791 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359793 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359796 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359800 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359803 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359806 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.359809 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359895 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359905 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359913 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359920 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359924 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359928 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 16:30:09.458857 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359932 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359936 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359939 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359942 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359946 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359949 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359952 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359955 2564 flags.go:64] FLAG: --cgroup-root="" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359958 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359961 2564 flags.go:64] FLAG: --client-ca-file="" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359964 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359967 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359971 2564 flags.go:64] FLAG: --cluster-domain="" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359974 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359977 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359980 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359983 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359989 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359992 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359995 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.359999 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360001 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360004 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360007 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 16:30:09.460817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360010 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360014 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360019 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360022 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360025 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360028 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360031 2564 flags.go:64] FLAG: --enable-server="true" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360034 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360039 2564 flags.go:64] FLAG: --event-burst="100" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360042 2564 flags.go:64] FLAG: --event-qps="50" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360045 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360048 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360051 2564 flags.go:64] FLAG: --eviction-hard="" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360055 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360058 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360061 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360064 2564 flags.go:64] FLAG: --eviction-soft="" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360067 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360069 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360072 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360075 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360078 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360081 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360083 2564 flags.go:64] FLAG: --feature-gates="" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360087 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 16:30:09.461555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360091 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360095 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360098 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360101 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360104 2564 flags.go:64] FLAG: --help="false" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360107 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-135-252.ec2.internal" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360110 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360112 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360115 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360120 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360123 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360126 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360129 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360131 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360134 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360138 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360141 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360144 2564 flags.go:64] FLAG: --kube-reserved="" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360147 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360150 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360153 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360155 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360158 2564 flags.go:64] FLAG: --lock-file="" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360161 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 16:30:09.463758 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360164 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360166 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360172 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360174 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360177 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360180 2564 flags.go:64] FLAG: --logging-format="text" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360183 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360187 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360191 2564 flags.go:64] FLAG: --manifest-url="" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360194 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360198 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360201 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360205 2564 flags.go:64] FLAG: --max-pods="110" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360208 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360210 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360213 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360216 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360220 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360223 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360226 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360233 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360236 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360239 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 16:30:09.464514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360242 2564 flags.go:64] FLAG: --pod-cidr="" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360245 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360251 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360254 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360258 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360261 2564 flags.go:64] FLAG: --port="10250" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360264 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360267 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-079bd2687a765a7bf" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360270 2564 flags.go:64] FLAG: --qos-reserved="" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360273 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360276 2564 flags.go:64] FLAG: --register-node="true" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360279 2564 flags.go:64] FLAG: --register-with-taints="" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360282 2564 flags.go:64] FLAG: --registry-burst="10" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360285 2564 flags.go:64] FLAG: --registry-qps="5" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360288 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360291 2564 flags.go:64] FLAG: --reserved-memory="" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360294 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360298 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360302 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360304 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360307 2564 flags.go:64] FLAG: --runonce="false" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360310 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360313 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360316 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360319 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 16:30:09.466038 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360322 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360324 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360329 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360332 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360334 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360337 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360340 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360343 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360346 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360350 2564 flags.go:64] FLAG: --system-cgroups="" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360352 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360358 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360360 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360363 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360367 2564 flags.go:64] FLAG: --tls-min-version="" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360369 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360373 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360376 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360393 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360397 2564 flags.go:64] FLAG: --v="2" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360401 2564 flags.go:64] FLAG: --version="false" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360406 2564 flags.go:64] FLAG: --vmodule="" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360409 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.360413 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360571 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:30:09.568769 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360579 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360582 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360587 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360593 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360596 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360600 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360603 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360606 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360609 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360611 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360614 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360617 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360619 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360622 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360625 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360627 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360630 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360633 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360636 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:30:09.569975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360639 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360642 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360644 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360647 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360649 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360652 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360655 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360657 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360660 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360664 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360667 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360670 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360673 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360677 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360680 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360682 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360685 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360688 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360690 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:30:09.570845 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360693 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360697 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360700 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360703 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360706 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360709 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360711 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360714 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360716 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360719 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360721 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360724 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360728 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360731 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360734 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360737 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360739 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360742 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360744 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:30:09.571701 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360747 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360749 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360752 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360755 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360757 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360760 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360763 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360766 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360769 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360772 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360774 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360777 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360780 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360783 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360785 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360788 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360790 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360793 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360796 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360798 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:30:09.574283 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360801 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360804 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360806 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360809 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360812 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360819 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360822 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360825 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360827 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360830 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360833 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360835 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360838 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360841 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360843 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360846 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360848 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360851 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360854 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360856 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:30:09.575119 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.360859 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.361476 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.368193 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.368219 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.368239 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.368244 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368303 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368308 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368311 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368314 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368317 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368320 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368326 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368329 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368332 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:30:09.575979 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368334 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368337 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368340 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368346 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368349 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368351 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368353 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368356 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368359 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368362 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368364 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368368 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368370 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368373 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368376 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368394 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368398 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368403 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368408 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368413 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:30:09.576838 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368417 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368419 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368422 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368425 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368428 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368432 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368435 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368438 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368441 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368445 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368447 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368450 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368452 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368455 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368458 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368461 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368463 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368466 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368468 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:30:09.578967 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368471 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368474 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368476 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368479 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368481 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368484 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368487 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368489 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368492 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368495 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368497 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368500 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368504 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368507 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368509 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368512 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368514 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368517 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368519 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368522 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:30:09.579827 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368524 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368527 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368531 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368533 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368536 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368538 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368541 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368544 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368546 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368549 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368551 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368554 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368556 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368559 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368561 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368564 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368567 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368570 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368574 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:30:09.581557 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368576 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368579 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368582 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368584 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368586 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368591 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368594 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368596 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368599 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368602 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368604 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368606 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.368612 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368724 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:30:09.582430 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368729 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368732 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368738 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368741 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368745 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368748 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368751 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368754 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368756 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368759 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368762 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368764 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368767 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368769 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368772 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368775 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368777 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368780 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368782 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368785 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:30:09.584138 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368788 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368790 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368793 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368797 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368799 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368803 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368806 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368810 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368813 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368816 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368819 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368822 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368824 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368827 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368831 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368834 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368837 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368839 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368841 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:30:09.584996 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368844 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368847 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368849 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368852 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368854 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368857 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368859 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368861 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368864 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368866 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368869 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368871 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368874 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368876 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368879 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368881 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368885 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368888 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368890 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368893 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:30:09.586720 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368896 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368898 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368901 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368904 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368906 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368909 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368911 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368915 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368918 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368920 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368923 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368925 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368928 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368930 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368933 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368935 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368938 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368940 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368943 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368945 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:30:09.587586 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368948 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368950 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368953 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368956 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368958 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368961 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368963 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368966 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368970 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368972 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368975 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368977 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368980 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368983 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368985 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368988 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368990 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368993 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:30:09.589277 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:09.368995 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.369002 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.369114 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.373406 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.374548 2564 server.go:1019] "Starting client certificate rotation" Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.374643 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.374674 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.376693 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.377913 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.385900 2564 log.go:25] "Validated CRI v1 runtime API" Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.387955 2564 log.go:25] "Validated CRI v1 image API" Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.388751 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 16:30:09.590124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.393086 2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 88ef7913-dcd0-488b-aacd-01e0cf5ef685:/dev/nvme0n1p3 e7b5a815-8a36-40e1-9dde-4b5c5e4d6e5a:/dev/nvme0n1p4] Jul 14 16:30:09.592256 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.393105 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 16:30:09.592693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.397806 2564 manager.go:216] Machine: {Timestamp:2026-07-14 16:30:09.396744238 +0000 UTC m=+0.258133514 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100312 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29db0f2ef0719d7d65235d488e09d5 SystemUUID:ec29db0f-2ef0-719d-7d65-235d488e09d5 BootID:b8ec1cfd-c6b2-49fe-8958-c9ad4bf6ad43 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:35:02:eb:6b:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:35:02:eb:6b:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:4c:28:d3:67:fa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 16:30:09.592693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.397916 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 16:30:09.592693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.397997 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 16:30:09.592693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.400265 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 16:30:09.592693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.400295 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-252.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 16:30:09.592693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.401339 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 16:30:09.592693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.401350 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 16:30:09.592693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.401358 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.401370 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.402223 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.405996 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.406113 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.406658 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.406676 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.406691 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.406701 2564 kubelet.go:398] "Adding apiserver pod source" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.406715 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.407650 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.407677 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.410154 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.411741 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.411779 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412399 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412418 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412426 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412434 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412446 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412453 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412464 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412473 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412482 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412490 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412502 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.412510 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.413124 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.413134 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.413535 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.417157 2564 server.go:1268] "Started kubelet" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.417211 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.417291 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.417368 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.418528 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.419095 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.421550 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-252.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.423168 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.423190 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.423280 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.423864 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.423880 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.423893 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.423999 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 14 16:30:09.593115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.424007 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.424150 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.424353 2564 factory.go:153] Registering CRI-O factory Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.424409 2564 factory.go:223] Registration of the crio container factory successfully Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.424470 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.424479 2564 factory.go:55] Registering systemd factory Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.424487 2564 factory.go:223] Registration of the systemd container factory successfully Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.424505 2564 factory.go:103] Registering Raw factory Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.424518 2564 manager.go:1196] Started watching for new ooms in manager Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.424862 2564 manager.go:349] Starting recovery of all containers Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.426358 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-252.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.426502 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.426554 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-252.ec2.internal.18c234f0610c3f88 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-252.ec2.internal,UID:ip-10-0-135-252.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-252.ec2.internal,},FirstTimestamp:2026-07-14 16:30:09.417125768 +0000 UTC m=+0.278515091,LastTimestamp:2026-07-14 16:30:09.417125768 +0000 UTC m=+0.278515091,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-252.ec2.internal,}" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.427498 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-252.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.427554 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.437982 2564 manager.go:354] Recovery completed Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.442033 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.444068 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientMemory" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.444105 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.444121 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientPID" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.444716 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.444727 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.444765 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.444774 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.446375 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientMemory" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.446414 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 16:30:09.594424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.446437 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientPID" Jul 14 16:30:09.596116 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.459412 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-252.ec2.internal.18c234f062a79fa2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-252.ec2.internal,UID:ip-10-0-135-252.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-252.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-252.ec2.internal,},FirstTimestamp:2026-07-14 16:30:09.444085666 +0000 UTC m=+0.305474946,LastTimestamp:2026-07-14 16:30:09.444085666 +0000 UTC m=+0.305474946,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-252.ec2.internal,}" Jul 14 16:30:09.596116 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.507333 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qfqlm" Jul 14 16:30:09.596116 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.522159 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qfqlm" Jul 14 16:30:09.596116 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.524374 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 14 16:30:09.704899 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.624590 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 14 16:30:09.726682 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.725675 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 14 16:30:09.832855 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.730779 2564 policy_none.go:49] "None policy: Start" Jul 14 16:30:09.832855 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.730796 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 16:30:09.832855 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.730809 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 16:30:09.832855 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.733110 2564 policy_none.go:47] "Start" Jul 14 16:30:09.832855 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.826732 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 14 16:30:09.954823 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.927570 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 14 16:30:09.954823 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.950683 2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-252.ec2.internal\" not found" node="ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.074094 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.995508 2564 manager.go:337] "Starting Device Plugin manager" Jul 14 16:30:10.074094 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:09.995546 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 16:30:10.074094 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.995557 2564 server.go:87] "Starting device plugin registration server" Jul 14 16:30:10.074094 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.995847 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 16:30:10.074094 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.995857 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 16:30:10.074094 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.995960 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 16:30:10.074094 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.996106 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 16:30:10.074094 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:09.996116 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 16:30:10.202012 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.185934 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 16:30:10.202012 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:10.186090 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 16:30:10.202012 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:10.186158 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-252.ec2.internal\" not found" Jul 14 16:30:10.202012 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.187154 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientMemory" Jul 14 16:30:10.202012 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.187192 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 16:30:10.202012 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.187208 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientPID" Jul 14 16:30:10.202012 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.187242 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.338587 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.204864 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.338587 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:10.204888 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-252.ec2.internal\": node \"ip-10-0-135-252.ec2.internal\" not found" Jul 14 16:30:10.338587 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:10.243192 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 14 16:30:10.347313 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:10.343510 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 14 16:30:10.374711 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.374670 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 16:30:10.435541 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.435516 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 16:30:10.480047 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.479994 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 16:30:10.481305 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.481288 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 16:30:10.481354 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.481328 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 16:30:10.481434 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.481355 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 16:30:10.481434 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:10.481412 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 16:30:10.484288 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.484270 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 16:30:10.527863 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.527819 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 16:25:09 +0000 UTC" deadline="2028-04-23 13:04:07.009189432 +0000 UTC" Jul 14 16:30:10.527863 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.527854 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15572h33m56.481338889s" Jul 14 16:30:10.582351 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.582243 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal"] Jul 14 16:30:10.585833 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.585812 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.587924 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.587898 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.615361 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.615333 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.620041 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.620024 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.629037 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.629019 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 16:30:10.632659 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.632644 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 16:30:10.678315 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.678283 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 16:30:10.688034 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.687998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbcfbc2fdebeb48346da1bb838f11040-config\") pod \"kube-apiserver-proxy-ip-10-0-135-252.ec2.internal\" (UID: \"bbcfbc2fdebeb48346da1bb838f11040\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.688135 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.688063 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.688135 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.688098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.774601 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.774564 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 16:30:10.788926 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.788890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.789044 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.788943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.789044 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.788973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbcfbc2fdebeb48346da1bb838f11040-config\") pod \"kube-apiserver-proxy-ip-10-0-135-252.ec2.internal\" (UID: \"bbcfbc2fdebeb48346da1bb838f11040\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.789044 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.788984 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.789044 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.789024 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbcfbc2fdebeb48346da1bb838f11040-config\") pod \"kube-apiserver-proxy-ip-10-0-135-252.ec2.internal\" (UID: \"bbcfbc2fdebeb48346da1bb838f11040\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.789196 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.789073 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.936146 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.936061 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 14 16:30:10.936285 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:10.936061 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 14 16:30:11.408984 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.408950 2564 apiserver.go:52] "Watching apiserver" Jul 14 16:30:11.419149 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.419121 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 16:30:11.419485 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.419463 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-4qjts","openshift-image-registry/node-ca-wvd67","openshift-multus/multus-additional-cni-plugins-66fch","openshift-multus/multus-zgjjp","openshift-multus/network-metrics-daemon-gnjbs","openshift-network-diagnostics/network-check-target-lqnfn","openshift-ovn-kubernetes/ovnkube-node-xb9lb","kube-system/global-pull-secret-syncer-snds6","kube-system/konnectivity-agent-cjlks","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw","openshift-cluster-node-tuning-operator/tuned-9tt69","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal","openshift-network-operator/iptables-alerter-f4ldb","kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal"] Jul 14 16:30:11.422083 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.422060 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.424143 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.424122 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 16:30:11.424257 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.424237 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.426395 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.426363 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.427118 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.427099 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 16:30:11.427205 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.427101 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 16:30:11.427205 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.427165 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pp95f\"" Jul 14 16:30:11.428461 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.428445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.428860 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.428844 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 16:30:11.430776 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.430750 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:11.430861 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.430834 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:11.432818 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.432803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:11.432871 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.432856 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:11.435046 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.435027 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.437230 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.437212 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:11.437300 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.437280 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:11.439300 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.439284 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:11.439767 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.439748 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 16:30:11.439864 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.439783 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rmmcc\"" Jul 14 16:30:11.439937 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.439920 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 16:30:11.440001 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.439988 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 16:30:11.440059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.440043 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 16:30:11.440090 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.440064 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 16:30:11.440165 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.440152 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 16:30:11.440237 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.440219 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 16:30:11.440299 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.440249 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 16:30:11.441160 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.441143 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 16:30:11.441241 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.441195 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 16:30:11.441241 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.441225 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 16:30:11.441241 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.441232 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 16:30:11.441377 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.441248 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6wgwn\"" Jul 14 16:30:11.441377 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.441275 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wcrnz\"" Jul 14 16:30:11.441486 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.441442 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 16:30:11.441533 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.441495 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 16:30:11.442343 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.441819 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.442343 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.441863 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l6hxc\"" Jul 14 16:30:11.445262 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.445246 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.447137 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.447122 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 16:30:11.447877 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.447859 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.448138 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.448122 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 16:30:11.448200 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.448157 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tdmvv\"" Jul 14 16:30:11.448373 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.448358 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 16:30:11.448442 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.448419 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 16:30:11.448550 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.448538 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n45bd\"" Jul 14 16:30:11.448680 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.448664 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:30:11.448756 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.448743 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 16:30:11.449634 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.449621 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4lxww\"" Jul 14 16:30:11.450282 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.450268 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 16:30:11.451815 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.451801 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:30:11.452055 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.452040 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 16:30:11.452938 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.452926 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 16:30:11.453353 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.453341 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 16:30:11.453428 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.453416 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5rdcv\"" Jul 14 16:30:11.491095 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lcf9\" (UniqueName: \"kubernetes.io/projected/68ac6474-3dc9-46a3-95ce-19a2210f461e-kube-api-access-7lcf9\") pod \"node-resolver-4qjts\" (UID: \"68ac6474-3dc9-46a3-95ce-19a2210f461e\") " pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491102 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-system-cni-dir\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-os-release\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-cnibin\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491229 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68ac6474-3dc9-46a3-95ce-19a2210f461e-hosts-file\") pod \"node-resolver-4qjts\" (UID: \"68ac6474-3dc9-46a3-95ce-19a2210f461e\") " pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8441833e-789c-4a31-ab22-3ad366b2b974-host\") pod \"node-ca-wvd67\" (UID: \"8441833e-789c-4a31-ab22-3ad366b2b974\") " pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8441833e-789c-4a31-ab22-3ad366b2b974-serviceca\") pod \"node-ca-wvd67\" (UID: \"8441833e-789c-4a31-ab22-3ad366b2b974\") " pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzq2g\" (UniqueName: \"kubernetes.io/projected/8441833e-789c-4a31-ab22-3ad366b2b974-kube-api-access-bzq2g\") pod \"node-ca-wvd67\" (UID: \"8441833e-789c-4a31-ab22-3ad366b2b974\") " pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzs2f\" (UniqueName: \"kubernetes.io/projected/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-kube-api-access-xzs2f\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.491677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.491481 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ac6474-3dc9-46a3-95ce-19a2210f461e-tmp-dir\") pod \"node-resolver-4qjts\" (UID: \"68ac6474-3dc9-46a3-95ce-19a2210f461e\") " pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.502545 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:11.502498 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58eb7529d0ca1f7fbba34204ef0f772b.slice/crio-7e0f229799383efd53f4ecf952ab4a1a1c1aaf93ceda80c140c0573f13ca90df WatchSource:0}: Error finding container 7e0f229799383efd53f4ecf952ab4a1a1c1aaf93ceda80c140c0573f13ca90df: Status 404 returned error can't find the container with id 7e0f229799383efd53f4ecf952ab4a1a1c1aaf93ceda80c140c0573f13ca90df Jul 14 16:30:11.506733 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.506718 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 16:30:11.510804 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.510782 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wp9b7" Jul 14 16:30:11.525531 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.525515 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 16:30:11.526917 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.526900 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wp9b7" Jul 14 16:30:11.592467 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:11.592467 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592463 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-kubelet\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.592665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-etc-openvswitch\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.592665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-dbus\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:11.592665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-device-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.592665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-os-release\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.592665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-cni-binary-copy\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.592665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-var-lib-cni-multus\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.592665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-conf-dir\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.592866 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzq2g\" (UniqueName: \"kubernetes.io/projected/8441833e-789c-4a31-ab22-3ad366b2b974-kube-api-access-bzq2g\") pod \"node-ca-wvd67\" (UID: \"8441833e-789c-4a31-ab22-3ad366b2b974\") " pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.592866 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.592866 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr6bb\" (UniqueName: \"kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb\") pod \"network-check-target-lqnfn\" (UID: \"5ea99c9e-73c9-4d79-815b-b0d0473ec652\") " pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:11.592866 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-sysconfig\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.592866 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-run-openvswitch\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.593046 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592900 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-ovnkube-config\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.593046 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592925 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl54p\" (UniqueName: \"kubernetes.io/projected/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-kube-api-access-rl54p\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.593046 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-hostroot\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.593046 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.592975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lcf9\" (UniqueName: \"kubernetes.io/projected/68ac6474-3dc9-46a3-95ce-19a2210f461e-kube-api-access-7lcf9\") pod \"node-resolver-4qjts\" (UID: \"68ac6474-3dc9-46a3-95ce-19a2210f461e\") " pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.593046 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.593617 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593071 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-run-ovn\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.593617 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-run-netns\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.593617 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-run\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.593617 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-run-systemd\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.593617 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593511 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-log-socket\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.593617 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-ovn-node-metrics-cert\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.593617 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-sys-fs\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.594078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-run-k8s-cni-cncf-io\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.594078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593647 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.594078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-etc-kubernetes\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.594078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593726 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e065641-348b-46e7-a6aa-aa390353c034-konnectivity-ca\") pod \"konnectivity-agent-cjlks\" (UID: \"7e065641-348b-46e7-a6aa-aa390353c034\") " pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:11.594078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-socket-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.594078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593791 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-ovnkube-script-lib\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.594078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8441833e-789c-4a31-ab22-3ad366b2b974-serviceca\") pod \"node-ca-wvd67\" (UID: \"8441833e-789c-4a31-ab22-3ad366b2b974\") " pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.594078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-modprobe-d\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.594078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-slash\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.594476 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-node-log\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.594476 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.593675 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.594476 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-run-multus-certs\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.594476 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:11.594476 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594245 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ac6474-3dc9-46a3-95ce-19a2210f461e-tmp-dir\") pod \"node-resolver-4qjts\" (UID: \"68ac6474-3dc9-46a3-95ce-19a2210f461e\") " pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.594476 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-kubernetes\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.594476 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594283 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8441833e-789c-4a31-ab22-3ad366b2b974-serviceca\") pod \"node-ca-wvd67\" (UID: \"8441833e-789c-4a31-ab22-3ad366b2b974\") " pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.594476 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-systemd\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.594816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594535 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-lib-modules\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.594816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594591 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-systemd-units\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.594816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-var-lib-openvswitch\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.594816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-kubelet-config\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:11.594816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594625 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ac6474-3dc9-46a3-95ce-19a2210f461e-tmp-dir\") pod \"node-resolver-4qjts\" (UID: \"68ac6474-3dc9-46a3-95ce-19a2210f461e\") " pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.594816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-cnibin\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.594816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-tuned\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.595151 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcrmk\" (UniqueName: \"kubernetes.io/projected/5804bd95-b180-4048-8bc2-ed666bc1b52f-kube-api-access-xcrmk\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.595151 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.594972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-daemon-config\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.595151 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66wsv\" (UniqueName: \"kubernetes.io/projected/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-kube-api-access-66wsv\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.595151 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595045 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68ac6474-3dc9-46a3-95ce-19a2210f461e-hosts-file\") pod \"node-resolver-4qjts\" (UID: \"68ac6474-3dc9-46a3-95ce-19a2210f461e\") " pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.595151 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595068 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-sysctl-d\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.595151 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5804bd95-b180-4048-8bc2-ed666bc1b52f-tmp\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.595423 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28076354-d9d9-48c7-b1ae-aea8bc426a52-iptables-alerter-script\") pod \"iptables-alerter-f4ldb\" (UID: \"28076354-d9d9-48c7-b1ae-aea8bc426a52\") " pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.595423 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-host\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.595423 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595238 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e065641-348b-46e7-a6aa-aa390353c034-agent-certs\") pod \"konnectivity-agent-cjlks\" (UID: \"7e065641-348b-46e7-a6aa-aa390353c034\") " pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:11.595423 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-system-cni-dir\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.595423 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-os-release\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.595423 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.595686 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rwqk\" (UniqueName: \"kubernetes.io/projected/c736041f-ea1d-4f32-a0a1-4a6a708c9257-kube-api-access-7rwqk\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:11.595686 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-cnibin\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.595769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-etc-selinux\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.595769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.595862 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-registration-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.595862 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-system-cni-dir\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.595862 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-var-lib-kubelet\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.596018 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-env-overrides\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.596018 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8441833e-789c-4a31-ab22-3ad366b2b974-host\") pod \"node-ca-wvd67\" (UID: \"8441833e-789c-4a31-ab22-3ad366b2b974\") " pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.596018 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.595933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzs2f\" (UniqueName: \"kubernetes.io/projected/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-kube-api-access-xzs2f\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.596156 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r6j2\" (UniqueName: \"kubernetes.io/projected/28076354-d9d9-48c7-b1ae-aea8bc426a52-kube-api-access-9r6j2\") pod \"iptables-alerter-f4ldb\" (UID: \"28076354-d9d9-48c7-b1ae-aea8bc426a52\") " pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.596213 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-run-netns\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.596267 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-run-ovn-kubernetes\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.596267 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-cni-bin\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.596350 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-socket-dir-parent\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.596665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-sysctl-conf\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.596770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596668 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-os-release\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.596770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596677 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-sys\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.596770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596705 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-system-cni-dir\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.596770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596728 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28076354-d9d9-48c7-b1ae-aea8bc426a52-host-slash\") pod \"iptables-alerter-f4ldb\" (UID: \"28076354-d9d9-48c7-b1ae-aea8bc426a52\") " pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.596936 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.596769 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-cnibin\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.597160 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-cni-netd\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.597217 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597166 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8441833e-789c-4a31-ab22-3ad366b2b974-host\") pod \"node-ca-wvd67\" (UID: \"8441833e-789c-4a31-ab22-3ad366b2b974\") " pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.597217 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68ac6474-3dc9-46a3-95ce-19a2210f461e-hosts-file\") pod \"node-resolver-4qjts\" (UID: \"68ac6474-3dc9-46a3-95ce-19a2210f461e\") " pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.597217 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-kubelet-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.597341 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4gsv\" (UniqueName: \"kubernetes.io/projected/f7382797-711d-41fd-b5cd-ca4b0ddc1060-kube-api-access-z4gsv\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.597341 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-cni-dir\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.597341 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-var-lib-cni-bin\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.597341 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.597341 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597328 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-var-lib-kubelet\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.597570 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597441 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.597710 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.597692 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.609045 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.609019 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 16:30:11.612254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.612229 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzq2g\" (UniqueName: \"kubernetes.io/projected/8441833e-789c-4a31-ab22-3ad366b2b974-kube-api-access-bzq2g\") pod \"node-ca-wvd67\" (UID: \"8441833e-789c-4a31-ab22-3ad366b2b974\") " pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.612342 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.612232 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzs2f\" (UniqueName: \"kubernetes.io/projected/37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c-kube-api-access-xzs2f\") pod \"multus-additional-cni-plugins-66fch\" (UID: \"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c\") " pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.614529 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.614511 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lcf9\" (UniqueName: \"kubernetes.io/projected/68ac6474-3dc9-46a3-95ce-19a2210f461e-kube-api-access-7lcf9\") pod \"node-resolver-4qjts\" (UID: \"68ac6474-3dc9-46a3-95ce-19a2210f461e\") " pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.697835 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.697739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-run-systemd\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.697835 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.697781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-log-socket\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.697835 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.697800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-ovn-node-metrics-cert\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.697859 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-log-socket\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.697863 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-run-systemd\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.697909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-sys-fs\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.697936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-run-k8s-cni-cncf-io\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.697966 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-run-k8s-cni-cncf-io\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.697982 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-sys-fs\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-etc-kubernetes\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e065641-348b-46e7-a6aa-aa390353c034-konnectivity-ca\") pod \"konnectivity-agent-cjlks\" (UID: \"7e065641-348b-46e7-a6aa-aa390353c034\") " pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698060 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-etc-kubernetes\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-socket-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.698103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-ovnkube-script-lib\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-modprobe-d\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-slash\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-node-log\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698236 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-socket-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-slash\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-node-log\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-run-multus-certs\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698350 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-modprobe-d\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698401 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-run-multus-certs\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-kubernetes\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-systemd\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-lib-modules\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-systemd-units\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.698616 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.698501 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698507 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-kubernetes\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698517 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-var-lib-openvswitch\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698541 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-systemd\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-kubelet-config\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698559 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-systemd-units\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.698579 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs podName:c736041f-ea1d-4f32-a0a1-4a6a708c9257 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:12.198557706 +0000 UTC m=+3.059946982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs") pod "network-metrics-daemon-gnjbs" (UID: "c736041f-ea1d-4f32-a0a1-4a6a708c9257") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698605 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-var-lib-openvswitch\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698620 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-lib-modules\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698636 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-kubelet-config\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-cnibin\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698640 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e065641-348b-46e7-a6aa-aa390353c034-konnectivity-ca\") pod \"konnectivity-agent-cjlks\" (UID: \"7e065641-348b-46e7-a6aa-aa390353c034\") " pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-tuned\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcrmk\" (UniqueName: \"kubernetes.io/projected/5804bd95-b180-4048-8bc2-ed666bc1b52f-kube-api-access-xcrmk\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.699266 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698690 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-cnibin\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-daemon-config\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66wsv\" (UniqueName: \"kubernetes.io/projected/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-kube-api-access-66wsv\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-sysctl-d\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5804bd95-b180-4048-8bc2-ed666bc1b52f-tmp\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28076354-d9d9-48c7-b1ae-aea8bc426a52-iptables-alerter-script\") pod \"iptables-alerter-f4ldb\" (UID: \"28076354-d9d9-48c7-b1ae-aea8bc426a52\") " pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-host\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e065641-348b-46e7-a6aa-aa390353c034-agent-certs\") pod \"konnectivity-agent-cjlks\" (UID: \"7e065641-348b-46e7-a6aa-aa390353c034\") " pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698953 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-sysctl-d\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rwqk\" (UniqueName: \"kubernetes.io/projected/c736041f-ea1d-4f32-a0a1-4a6a708c9257-kube-api-access-7rwqk\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.698994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-etc-selinux\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699013 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-registration-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699039 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-system-cni-dir\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.699954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-var-lib-kubelet\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699097 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-env-overrides\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r6j2\" (UniqueName: \"kubernetes.io/projected/28076354-d9d9-48c7-b1ae-aea8bc426a52-kube-api-access-9r6j2\") pod \"iptables-alerter-f4ldb\" (UID: \"28076354-d9d9-48c7-b1ae-aea8bc426a52\") " pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-run-netns\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-run-ovn-kubernetes\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699184 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-cni-bin\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-socket-dir-parent\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699252 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-var-lib-kubelet\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699367 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-host\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699411 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-ovnkube-script-lib\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-sysctl-conf\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-sys\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28076354-d9d9-48c7-b1ae-aea8bc426a52-host-slash\") pod \"iptables-alerter-f4ldb\" (UID: \"28076354-d9d9-48c7-b1ae-aea8bc426a52\") " pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.700605 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699486 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-run-netns\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-cni-netd\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699552 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-sysctl-conf\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699553 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28076354-d9d9-48c7-b1ae-aea8bc426a52-host-slash\") pod \"iptables-alerter-f4ldb\" (UID: \"28076354-d9d9-48c7-b1ae-aea8bc426a52\") " pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-kubelet-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4gsv\" (UniqueName: \"kubernetes.io/projected/f7382797-711d-41fd-b5cd-ca4b0ddc1060-kube-api-access-z4gsv\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699642 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-etc-selinux\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28076354-d9d9-48c7-b1ae-aea8bc426a52-iptables-alerter-script\") pod \"iptables-alerter-f4ldb\" (UID: \"28076354-d9d9-48c7-b1ae-aea8bc426a52\") " pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-cni-dir\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-var-lib-cni-bin\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699708 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-system-cni-dir\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-var-lib-kubelet\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699782 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-cni-netd\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699785 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-kubelet-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.701254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699796 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-cni-dir\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699824 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-run-ovn-kubernetes\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699861 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-socket-dir-parent\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699868 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-var-lib-cni-bin\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699897 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-cni-bin\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699903 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-env-overrides\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699940 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-registration-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699943 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-var-lib-kubelet\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.699995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-sys\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.700017 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-kubelet\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-etc-openvswitch\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.700067 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret podName:dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:12.200052004 +0000 UTC m=+3.061441272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret") pod "global-pull-secret-syncer-snds6" (UID: "dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:11.701760 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700092 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-host-kubelet\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-dbus\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-device-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700105 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-etc-openvswitch\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-os-release\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-cni-binary-copy\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700213 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-dbus\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700217 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7382797-711d-41fd-b5cd-ca4b0ddc1060-device-dir\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-var-lib-cni-multus\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700271 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-os-release\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700276 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-var-lib-cni-multus\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-conf-dir\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700331 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-conf-dir\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr6bb\" (UniqueName: \"kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb\") pod \"network-check-target-lqnfn\" (UID: \"5ea99c9e-73c9-4d79-815b-b0d0473ec652\") " pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-sysconfig\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.702128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-run-openvswitch\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-ovnkube-config\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl54p\" (UniqueName: \"kubernetes.io/projected/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-kube-api-access-rl54p\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-hostroot\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-run-ovn\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-run-netns\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-run\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700559 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-ovn-node-metrics-cert\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700745 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-host-run-netns\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700793 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-run-ovn\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700823 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-multus-daemon-config\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700832 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-sysconfig\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700824 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-cni-binary-copy\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700859 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-run-openvswitch\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700880 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5804bd95-b180-4048-8bc2-ed666bc1b52f-run\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.702660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700899 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-hostroot\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.703069 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.700945 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-ovnkube-config\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.703069 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.701407 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5804bd95-b180-4048-8bc2-ed666bc1b52f-etc-tuned\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.703069 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.701486 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e065641-348b-46e7-a6aa-aa390353c034-agent-certs\") pod \"konnectivity-agent-cjlks\" (UID: \"7e065641-348b-46e7-a6aa-aa390353c034\") " pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:11.703069 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.702544 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5804bd95-b180-4048-8bc2-ed666bc1b52f-tmp\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.718360 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.718334 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:30:11.718360 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.718353 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:30:11.718360 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.718362 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jr6bb for pod openshift-network-diagnostics/network-check-target-lqnfn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:11.718566 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:11.718441 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb podName:5ea99c9e-73c9-4d79-815b-b0d0473ec652 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:12.218424146 +0000 UTC m=+3.079813430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jr6bb" (UniqueName: "kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb") pod "network-check-target-lqnfn" (UID: "5ea99c9e-73c9-4d79-815b-b0d0473ec652") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:11.718678 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.718654 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66wsv\" (UniqueName: \"kubernetes.io/projected/6f486f2d-c58c-4b06-b80c-9d5953c6bca6-kube-api-access-66wsv\") pod \"multus-zgjjp\" (UID: \"6f486f2d-c58c-4b06-b80c-9d5953c6bca6\") " pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.719941 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.719914 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcrmk\" (UniqueName: \"kubernetes.io/projected/5804bd95-b180-4048-8bc2-ed666bc1b52f-kube-api-access-xcrmk\") pod \"tuned-9tt69\" (UID: \"5804bd95-b180-4048-8bc2-ed666bc1b52f\") " pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.720417 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.720397 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r6j2\" (UniqueName: \"kubernetes.io/projected/28076354-d9d9-48c7-b1ae-aea8bc426a52-kube-api-access-9r6j2\") pod \"iptables-alerter-f4ldb\" (UID: \"28076354-d9d9-48c7-b1ae-aea8bc426a52\") " pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.720804 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.720787 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl54p\" (UniqueName: \"kubernetes.io/projected/91eee248-1cb7-4b9d-b91e-7fec2a5fddef-kube-api-access-rl54p\") pod \"ovnkube-node-xb9lb\" (UID: \"91eee248-1cb7-4b9d-b91e-7fec2a5fddef\") " pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.720875 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.720807 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4gsv\" (UniqueName: \"kubernetes.io/projected/f7382797-711d-41fd-b5cd-ca4b0ddc1060-kube-api-access-z4gsv\") pod \"aws-ebs-csi-driver-node-47xhw\" (UID: \"f7382797-711d-41fd-b5cd-ca4b0ddc1060\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.724449 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.724433 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rwqk\" (UniqueName: \"kubernetes.io/projected/c736041f-ea1d-4f32-a0a1-4a6a708c9257-kube-api-access-7rwqk\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:11.747291 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.747269 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qjts" Jul 14 16:30:11.759574 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:11.759549 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ac6474_3dc9_46a3_95ce_19a2210f461e.slice/crio-27bde8cf0fb59738c67f5a45c7ec218f0e88133508e2c446a826139950ec3b66 WatchSource:0}: Error finding container 27bde8cf0fb59738c67f5a45c7ec218f0e88133508e2c446a826139950ec3b66: Status 404 returned error can't find the container with id 27bde8cf0fb59738c67f5a45c7ec218f0e88133508e2c446a826139950ec3b66 Jul 14 16:30:11.768450 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.768434 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wvd67" Jul 14 16:30:11.776394 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:11.776362 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8441833e_789c_4a31_ab22_3ad366b2b974.slice/crio-51e748075fb991ad1d75c617fe5e251403bd50d11ce544f5cf96536ef14baf9f WatchSource:0}: Error finding container 51e748075fb991ad1d75c617fe5e251403bd50d11ce544f5cf96536ef14baf9f: Status 404 returned error can't find the container with id 51e748075fb991ad1d75c617fe5e251403bd50d11ce544f5cf96536ef14baf9f Jul 14 16:30:11.785367 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.785348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-66fch" Jul 14 16:30:11.793914 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:11.793896 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37299eaa_8cfa_43e0_9c5f_8b84a48cbe4c.slice/crio-ea9f9097b7b796287fbf25b8ad6ad1cc331a6196c4f7fd81f6c0830f65bfa7f7 WatchSource:0}: Error finding container ea9f9097b7b796287fbf25b8ad6ad1cc331a6196c4f7fd81f6c0830f65bfa7f7: Status 404 returned error can't find the container with id ea9f9097b7b796287fbf25b8ad6ad1cc331a6196c4f7fd81f6c0830f65bfa7f7 Jul 14 16:30:11.806634 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.806613 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zgjjp" Jul 14 16:30:11.813546 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.813527 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:11.815457 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:11.815428 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f486f2d_c58c_4b06_b80c_9d5953c6bca6.slice/crio-586c21a960e83f0ebf79568129fb18fd36522ad45e263e94fc48438d9ae63c09 WatchSource:0}: Error finding container 586c21a960e83f0ebf79568129fb18fd36522ad45e263e94fc48438d9ae63c09: Status 404 returned error can't find the container with id 586c21a960e83f0ebf79568129fb18fd36522ad45e263e94fc48438d9ae63c09 Jul 14 16:30:11.818469 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.818454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:11.821928 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:11.821909 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91eee248_1cb7_4b9d_b91e_7fec2a5fddef.slice/crio-6a2d13977cb4ed039719a9b4185dc8b23601f7f16c610ed5ba83f32f7c7a6f9e WatchSource:0}: Error finding container 6a2d13977cb4ed039719a9b4185dc8b23601f7f16c610ed5ba83f32f7c7a6f9e: Status 404 returned error can't find the container with id 6a2d13977cb4ed039719a9b4185dc8b23601f7f16c610ed5ba83f32f7c7a6f9e Jul 14 16:30:11.822774 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.822760 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" Jul 14 16:30:11.826992 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:11.826969 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e065641_348b_46e7_a6aa_aa390353c034.slice/crio-59bc993d9cc4113c7d7ae4521e23e5f5bd234f2f032c722c49641a9dc574638a WatchSource:0}: Error finding container 59bc993d9cc4113c7d7ae4521e23e5f5bd234f2f032c722c49641a9dc574638a: Status 404 returned error can't find the container with id 59bc993d9cc4113c7d7ae4521e23e5f5bd234f2f032c722c49641a9dc574638a Jul 14 16:30:11.828540 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.828476 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9tt69" Jul 14 16:30:11.831594 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:11.831575 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7382797_711d_41fd_b5cd_ca4b0ddc1060.slice/crio-85610a9c01c3b68df0d9bee794e39fa9da3d14b6c8f251bf7c644ad021928ab4 WatchSource:0}: Error finding container 85610a9c01c3b68df0d9bee794e39fa9da3d14b6c8f251bf7c644ad021928ab4: Status 404 returned error can't find the container with id 85610a9c01c3b68df0d9bee794e39fa9da3d14b6c8f251bf7c644ad021928ab4 Jul 14 16:30:11.833178 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:11.833157 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f4ldb" Jul 14 16:30:11.836775 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:11.836740 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5804bd95_b180_4048_8bc2_ed666bc1b52f.slice/crio-f181b5f7e0e7eda5b38f50e42bcd462789625101986f802cd06f05a0e4bc0ec7 WatchSource:0}: Error finding container f181b5f7e0e7eda5b38f50e42bcd462789625101986f802cd06f05a0e4bc0ec7: Status 404 returned error can't find the container with id f181b5f7e0e7eda5b38f50e42bcd462789625101986f802cd06f05a0e4bc0ec7 Jul 14 16:30:11.842644 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:11.842620 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28076354_d9d9_48c7_b1ae_aea8bc426a52.slice/crio-1ef33619220bc9b9323e3537f0fd75b08f92e792678b51601c18cea1875bc74d WatchSource:0}: Error finding container 1ef33619220bc9b9323e3537f0fd75b08f92e792678b51601c18cea1875bc74d: Status 404 returned error can't find the container with id 1ef33619220bc9b9323e3537f0fd75b08f92e792678b51601c18cea1875bc74d Jul 14 16:30:12.204558 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.204515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:12.204718 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:12.204698 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:12.204786 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:12.204773 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret podName:dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:13.204750782 +0000 UTC m=+4.066140043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret") pod "global-pull-secret-syncer-snds6" (UID: "dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:12.204865 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.204804 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:12.204925 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:12.204912 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:12.204980 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:12.204953 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs podName:c736041f-ea1d-4f32-a0a1-4a6a708c9257 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:13.20494202 +0000 UTC m=+4.066331283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs") pod "network-metrics-daemon-gnjbs" (UID: "c736041f-ea1d-4f32-a0a1-4a6a708c9257") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:12.305353 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.305308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr6bb\" (UniqueName: \"kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb\") pod \"network-check-target-lqnfn\" (UID: \"5ea99c9e-73c9-4d79-815b-b0d0473ec652\") " pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:12.305558 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:12.305517 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:30:12.305558 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:12.305547 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:30:12.305558 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:12.305560 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jr6bb for pod openshift-network-diagnostics/network-check-target-lqnfn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:12.305719 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:12.305621 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb podName:5ea99c9e-73c9-4d79-815b-b0d0473ec652 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:13.305600713 +0000 UTC m=+4.166989976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr6bb" (UniqueName: "kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb") pod "network-check-target-lqnfn" (UID: "5ea99c9e-73c9-4d79-815b-b0d0473ec652") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:12.482964 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.482871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:12.483107 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:12.483008 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:12.488770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.488665 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f4ldb" event={"ID":"28076354-d9d9-48c7-b1ae-aea8bc426a52","Type":"ContainerStarted","Data":"1ef33619220bc9b9323e3537f0fd75b08f92e792678b51601c18cea1875bc74d"} Jul 14 16:30:12.491078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.490989 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" event={"ID":"f7382797-711d-41fd-b5cd-ca4b0ddc1060","Type":"ContainerStarted","Data":"85610a9c01c3b68df0d9bee794e39fa9da3d14b6c8f251bf7c644ad021928ab4"} Jul 14 16:30:12.492699 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.492612 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjlks" event={"ID":"7e065641-348b-46e7-a6aa-aa390353c034","Type":"ContainerStarted","Data":"59bc993d9cc4113c7d7ae4521e23e5f5bd234f2f032c722c49641a9dc574638a"} Jul 14 16:30:12.494550 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.494482 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zgjjp" event={"ID":"6f486f2d-c58c-4b06-b80c-9d5953c6bca6","Type":"ContainerStarted","Data":"586c21a960e83f0ebf79568129fb18fd36522ad45e263e94fc48438d9ae63c09"} Jul 14 16:30:12.496158 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.496088 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-66fch" event={"ID":"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c","Type":"ContainerStarted","Data":"ea9f9097b7b796287fbf25b8ad6ad1cc331a6196c4f7fd81f6c0830f65bfa7f7"} Jul 14 16:30:12.499641 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.499577 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wvd67" event={"ID":"8441833e-789c-4a31-ab22-3ad366b2b974","Type":"ContainerStarted","Data":"51e748075fb991ad1d75c617fe5e251403bd50d11ce544f5cf96536ef14baf9f"} Jul 14 16:30:12.502313 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.502288 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qjts" event={"ID":"68ac6474-3dc9-46a3-95ce-19a2210f461e","Type":"ContainerStarted","Data":"27bde8cf0fb59738c67f5a45c7ec218f0e88133508e2c446a826139950ec3b66"} Jul 14 16:30:12.504370 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.504346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" event={"ID":"58eb7529d0ca1f7fbba34204ef0f772b","Type":"ContainerStarted","Data":"7e0f229799383efd53f4ecf952ab4a1a1c1aaf93ceda80c140c0573f13ca90df"} Jul 14 16:30:12.506308 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.506284 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9tt69" event={"ID":"5804bd95-b180-4048-8bc2-ed666bc1b52f","Type":"ContainerStarted","Data":"f181b5f7e0e7eda5b38f50e42bcd462789625101986f802cd06f05a0e4bc0ec7"} Jul 14 16:30:12.508894 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.508806 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" event={"ID":"91eee248-1cb7-4b9d-b91e-7fec2a5fddef","Type":"ContainerStarted","Data":"6a2d13977cb4ed039719a9b4185dc8b23601f7f16c610ed5ba83f32f7c7a6f9e"} Jul 14 16:30:12.531473 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.531349 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 16:25:11 +0000 UTC" deadline="2028-04-11 20:19:47.32488525 +0000 UTC" Jul 14 16:30:12.531473 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:12.531418 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15291h49m34.793471152s" Jul 14 16:30:12.819722 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:12.819685 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbcfbc2fdebeb48346da1bb838f11040.slice/crio-4090ff0d405e2c95223da6e708b9549569a7605f166933a8e7047cf37cf7ced1 WatchSource:0}: Error finding container 4090ff0d405e2c95223da6e708b9549569a7605f166933a8e7047cf37cf7ced1: Status 404 returned error can't find the container with id 4090ff0d405e2c95223da6e708b9549569a7605f166933a8e7047cf37cf7ced1 Jul 14 16:30:13.212478 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:13.212394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:13.212653 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:13.212493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:13.212653 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:13.212568 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:13.212653 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:13.212639 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:13.212653 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:13.212650 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret podName:dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:15.212628981 +0000 UTC m=+6.074018272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret") pod "global-pull-secret-syncer-snds6" (UID: "dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:13.212873 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:13.212692 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs podName:c736041f-ea1d-4f32-a0a1-4a6a708c9257 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:15.212676052 +0000 UTC m=+6.074065328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs") pod "network-metrics-daemon-gnjbs" (UID: "c736041f-ea1d-4f32-a0a1-4a6a708c9257") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:13.313741 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:13.313700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr6bb\" (UniqueName: \"kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb\") pod \"network-check-target-lqnfn\" (UID: \"5ea99c9e-73c9-4d79-815b-b0d0473ec652\") " pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:13.313909 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:13.313854 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:30:13.313909 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:13.313873 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:30:13.313909 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:13.313886 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jr6bb for pod openshift-network-diagnostics/network-check-target-lqnfn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:13.314053 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:13.313943 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb podName:5ea99c9e-73c9-4d79-815b-b0d0473ec652 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:15.313924337 +0000 UTC m=+6.175313601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr6bb" (UniqueName: "kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb") pod "network-check-target-lqnfn" (UID: "5ea99c9e-73c9-4d79-815b-b0d0473ec652") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:13.486250 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:13.485509 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:13.486250 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:13.485646 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:13.486250 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:13.486085 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:13.486250 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:13.486199 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:13.514031 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:13.513994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" event={"ID":"bbcfbc2fdebeb48346da1bb838f11040","Type":"ContainerStarted","Data":"4090ff0d405e2c95223da6e708b9549569a7605f166933a8e7047cf37cf7ced1"} Jul 14 16:30:13.532582 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:13.532540 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 16:25:11 +0000 UTC" deadline="2028-02-05 06:18:23.952497032 +0000 UTC" Jul 14 16:30:13.532582 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:13.532581 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13693h48m10.419921105s" Jul 14 16:30:14.482985 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:14.482580 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:14.482985 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:14.482716 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:15.231784 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:15.231738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:15.232275 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:15.231885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:15.232275 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:15.231915 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:15.232275 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:15.231997 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret podName:dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:19.231976727 +0000 UTC m=+10.093366002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret") pod "global-pull-secret-syncer-snds6" (UID: "dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:15.232275 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:15.232006 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:15.232275 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:15.232060 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs podName:c736041f-ea1d-4f32-a0a1-4a6a708c9257 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:19.23204376 +0000 UTC m=+10.093433035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs") pod "network-metrics-daemon-gnjbs" (UID: "c736041f-ea1d-4f32-a0a1-4a6a708c9257") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:15.333654 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:15.332940 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr6bb\" (UniqueName: \"kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb\") pod \"network-check-target-lqnfn\" (UID: \"5ea99c9e-73c9-4d79-815b-b0d0473ec652\") " pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:15.333654 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:15.333184 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:30:15.333654 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:15.333207 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:30:15.333654 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:15.333222 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jr6bb for pod openshift-network-diagnostics/network-check-target-lqnfn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:15.333654 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:15.333325 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb podName:5ea99c9e-73c9-4d79-815b-b0d0473ec652 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:19.333304091 +0000 UTC m=+10.194693355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr6bb" (UniqueName: "kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb") pod "network-check-target-lqnfn" (UID: "5ea99c9e-73c9-4d79-815b-b0d0473ec652") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:15.482442 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:15.482348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:15.482608 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:15.482348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:15.482608 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:15.482534 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:15.482608 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:15.482577 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:16.482192 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:16.482159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:16.482651 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:16.482293 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:17.482054 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:17.481798 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:17.482193 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:17.481870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:17.482193 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:17.482168 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:17.482619 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:17.482229 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:18.481892 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:18.481855 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:18.482084 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:18.481999 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:19.266036 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:19.265995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:19.266505 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:19.266066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:19.266505 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:19.266170 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:19.266505 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:19.266172 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:19.266505 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:19.266241 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret podName:dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:27.266220009 +0000 UTC m=+18.127609289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret") pod "global-pull-secret-syncer-snds6" (UID: "dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:19.266505 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:19.266263 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs podName:c736041f-ea1d-4f32-a0a1-4a6a708c9257 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:27.266251096 +0000 UTC m=+18.127640363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs") pod "network-metrics-daemon-gnjbs" (UID: "c736041f-ea1d-4f32-a0a1-4a6a708c9257") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:19.367094 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:19.367040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr6bb\" (UniqueName: \"kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb\") pod \"network-check-target-lqnfn\" (UID: \"5ea99c9e-73c9-4d79-815b-b0d0473ec652\") " pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:19.367278 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:19.367215 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:30:19.367278 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:19.367237 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:30:19.367278 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:19.367249 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jr6bb for pod openshift-network-diagnostics/network-check-target-lqnfn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:19.367482 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:19.367303 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb podName:5ea99c9e-73c9-4d79-815b-b0d0473ec652 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:27.367286449 +0000 UTC m=+18.228675730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr6bb" (UniqueName: "kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb") pod "network-check-target-lqnfn" (UID: "5ea99c9e-73c9-4d79-815b-b0d0473ec652") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:19.482073 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:19.482013 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:19.482227 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:19.482058 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:19.482227 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:19.482157 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:19.482349 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:19.482296 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:20.483040 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:20.483009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:20.483541 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:20.483125 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:21.482044 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:21.481954 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:21.482044 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:21.481993 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:21.482278 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:21.482106 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:21.482278 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:21.482233 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:22.485698 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:22.485670 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:22.486136 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:22.485790 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:23.482005 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:23.481964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:23.482210 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:23.481964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:23.482210 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:23.482110 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:23.482210 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:23.482183 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:24.484619 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:24.484589 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:24.485011 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:24.484694 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:25.481982 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:25.481942 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:25.482152 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:25.481956 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:25.482152 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:25.482093 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:25.482152 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:25.482142 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:26.485702 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:26.485659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:26.486097 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:26.485813 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:27.325967 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:27.325923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:27.326178 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:27.325996 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:27.326178 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:27.326124 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:27.326284 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:27.326183 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs podName:c736041f-ea1d-4f32-a0a1-4a6a708c9257 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:43.32616858 +0000 UTC m=+34.187557840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs") pod "network-metrics-daemon-gnjbs" (UID: "c736041f-ea1d-4f32-a0a1-4a6a708c9257") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:27.326284 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:27.326126 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:27.326284 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:27.326274 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret podName:dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:43.326254887 +0000 UTC m=+34.187644160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret") pod "global-pull-secret-syncer-snds6" (UID: "dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:27.426300 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:27.426263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr6bb\" (UniqueName: \"kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb\") pod \"network-check-target-lqnfn\" (UID: \"5ea99c9e-73c9-4d79-815b-b0d0473ec652\") " pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:27.426518 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:27.426468 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:30:27.426518 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:27.426485 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:30:27.426518 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:27.426494 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jr6bb for pod openshift-network-diagnostics/network-check-target-lqnfn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:27.426678 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:27.426552 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb podName:5ea99c9e-73c9-4d79-815b-b0d0473ec652 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:43.426536242 +0000 UTC m=+34.287925509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr6bb" (UniqueName: "kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb") pod "network-check-target-lqnfn" (UID: "5ea99c9e-73c9-4d79-815b-b0d0473ec652") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:27.482275 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:27.482243 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:27.482489 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:27.482242 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:27.482489 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:27.482397 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:27.482489 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:27.482466 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:28.482586 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:28.482556 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:28.483009 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:28.482672 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:29.482367 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:29.482325 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:29.482562 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:29.482325 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:29.482562 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:29.482463 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:29.482562 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:29.482525 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:30.485229 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:30.485200 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:30.485633 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:30.485310 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:31.481928 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.481774 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:31.482051 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.481815 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:31.482051 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:31.482024 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:31.482128 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:31.482066 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:31.551644 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.551309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wvd67" event={"ID":"8441833e-789c-4a31-ab22-3ad366b2b974","Type":"ContainerStarted","Data":"815661ddafff36e8c3da16d3a277468140ea475bfc5b83896f93bae1c5a5ba98"} Jul 14 16:30:31.553632 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.553552 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qjts" event={"ID":"68ac6474-3dc9-46a3-95ce-19a2210f461e","Type":"ContainerStarted","Data":"2acfdae531282e9cd5a654d255e0108917c69290be15fee993958986b817542a"} Jul 14 16:30:31.557017 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.556985 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9tt69" event={"ID":"5804bd95-b180-4048-8bc2-ed666bc1b52f","Type":"ContainerStarted","Data":"f507f1328adf9dcb6a79f6eb9da1bcf983f356fac857ccf28bd8575658241f6c"} Jul 14 16:30:31.558748 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.558716 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" event={"ID":"91eee248-1cb7-4b9d-b91e-7fec2a5fddef","Type":"ContainerStarted","Data":"46a5106fdd181a1b146370dfa7ba917a8d383e9111903d1906af71c601514110"} Jul 14 16:30:31.558860 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.558794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" event={"ID":"91eee248-1cb7-4b9d-b91e-7fec2a5fddef","Type":"ContainerStarted","Data":"149cbfc3337d1ea0bd7324f6eaf8532a599ada65659a7e0b173826e5442c9717"} Jul 14 16:30:31.560011 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.559988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" event={"ID":"bbcfbc2fdebeb48346da1bb838f11040","Type":"ContainerStarted","Data":"d02c0427417417f734431741ebc16359a94aaab9360e92a715a4659dc6b2756b"} Jul 14 16:30:31.561377 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.561351 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" event={"ID":"f7382797-711d-41fd-b5cd-ca4b0ddc1060","Type":"ContainerStarted","Data":"015a739ffe3be3ace4af1bec27464ff46be94caf64ecbe9b7679bb4243ede3fe"} Jul 14 16:30:31.562900 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.562853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjlks" event={"ID":"7e065641-348b-46e7-a6aa-aa390353c034","Type":"ContainerStarted","Data":"27b381f092ff21e911cfbf0a5536bf81f5e72d2a5a0fb68b3d32bf86576d014c"} Jul 14 16:30:31.564479 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.564450 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zgjjp" event={"ID":"6f486f2d-c58c-4b06-b80c-9d5953c6bca6","Type":"ContainerStarted","Data":"321754e715007645b092c23f3da1adf0d9a380843d321df0965a045236f7f200"} Jul 14 16:30:31.565882 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.565860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-66fch" event={"ID":"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c","Type":"ContainerStarted","Data":"25ae8fd4b819dc82da26f9eb17815d8e94e4a5787f3c5951484289c8d48171d1"} Jul 14 16:30:31.572838 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.572728 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4qjts" podStartSLOduration=11.814193366 podStartE2EDuration="21.572711059s" totalImagesPullingTime="9.758517693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:31.572297536 +0000 UTC m=+22.433686826" watchObservedRunningTime="2026-07-14 16:30:31.572711059 +0000 UTC m=+22.434100342" Jul 14 16:30:31.612892 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.612838 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" podStartSLOduration=21.612813207 podStartE2EDuration="21.612813207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:31.587817862 +0000 UTC m=+22.449207146" watchObservedRunningTime="2026-07-14 16:30:31.612813207 +0000 UTC m=+22.474202491" Jul 14 16:30:31.630689 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.630594 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cjlks" podStartSLOduration=12.321363854 podStartE2EDuration="21.630579128s" totalImagesPullingTime="9.309215274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:31.630373063 +0000 UTC m=+22.491762346" watchObservedRunningTime="2026-07-14 16:30:31.630579128 +0000 UTC m=+22.491968412" Jul 14 16:30:31.648725 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.648681 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zgjjp" podStartSLOduration=2.570954939 podStartE2EDuration="21.648666099s" totalImagesPullingTime="19.07771116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:31.64784638 +0000 UTC m=+22.509235662" watchObservedRunningTime="2026-07-14 16:30:31.648666099 +0000 UTC m=+22.510055419" Jul 14 16:30:31.709978 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.709955 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:31.710506 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.710486 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:31.728008 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:31.727967 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9tt69" podStartSLOduration=2.70825701 podStartE2EDuration="21.727951026s" totalImagesPullingTime="19.019694016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:31.665562716 +0000 UTC m=+22.526952019" watchObservedRunningTime="2026-07-14 16:30:31.727951026 +0000 UTC m=+22.589340312" Jul 14 16:30:32.482541 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.482504 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:32.482768 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:32.482619 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:32.569306 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.569233 2564 generic.go:356] "Generic (PLEG): container finished" podID="58eb7529d0ca1f7fbba34204ef0f772b" containerID="77510e29bf79409f07523737e5cbdf75a15549ee3fa85dc993ee58c8b5635cff" exitCode=0 Jul 14 16:30:32.569731 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.569322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" event={"ID":"58eb7529d0ca1f7fbba34204ef0f772b","Type":"ContainerDied","Data":"77510e29bf79409f07523737e5cbdf75a15549ee3fa85dc993ee58c8b5635cff"} Jul 14 16:30:32.572460 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.572435 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" event={"ID":"91eee248-1cb7-4b9d-b91e-7fec2a5fddef","Type":"ContainerStarted","Data":"cc5e6b4394063512a2466a17e4d52bd36acac83ae139766afb87772779a707c6"} Jul 14 16:30:32.572578 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.572514 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" event={"ID":"91eee248-1cb7-4b9d-b91e-7fec2a5fddef","Type":"ContainerStarted","Data":"c686cc153fff2a151dcb91c13873e8a384f6d05e6c5aa3d12e7e37c27e69d849"} Jul 14 16:30:32.572634 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.572617 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" event={"ID":"91eee248-1cb7-4b9d-b91e-7fec2a5fddef","Type":"ContainerStarted","Data":"e59f11579abe65b99f7c5fd416e6d0954bbdd5e958179a169234814b4e0c3738"} Jul 14 16:30:32.572686 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.572669 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" event={"ID":"91eee248-1cb7-4b9d-b91e-7fec2a5fddef","Type":"ContainerStarted","Data":"68ad32a0fa85ada77b2aec69c775b4652a47e1aead64bc548eafb7788fd7a7f0"} Jul 14 16:30:32.575756 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.575734 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f4ldb" event={"ID":"28076354-d9d9-48c7-b1ae-aea8bc426a52","Type":"ContainerStarted","Data":"26720e09973166522157b4f96925dce62e9c2088afb6e2d33de0e0eac302ef01"} Jul 14 16:30:32.577049 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.577030 2564 generic.go:356] "Generic (PLEG): container finished" podID="37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c" containerID="25ae8fd4b819dc82da26f9eb17815d8e94e4a5787f3c5951484289c8d48171d1" exitCode=0 Jul 14 16:30:32.577156 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.577103 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-66fch" event={"ID":"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c","Type":"ContainerDied","Data":"25ae8fd4b819dc82da26f9eb17815d8e94e4a5787f3c5951484289c8d48171d1"} Jul 14 16:30:32.577349 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.577334 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:32.577942 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.577930 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cjlks" Jul 14 16:30:32.603829 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.603777 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wvd67" podStartSLOduration=8.87394989 podStartE2EDuration="22.603762383s" totalImagesPullingTime="13.729812493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:32.603363307 +0000 UTC m=+23.464752581" watchObservedRunningTime="2026-07-14 16:30:32.603762383 +0000 UTC m=+23.465151666" Jul 14 16:30:32.663662 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.663612 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f4ldb" podStartSLOduration=7.926551805 podStartE2EDuration="22.663597634s" totalImagesPullingTime="14.737045829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:32.663564086 +0000 UTC m=+23.524953368" watchObservedRunningTime="2026-07-14 16:30:32.663597634 +0000 UTC m=+23.524986917" Jul 14 16:30:32.769001 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:32.768968 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 16:30:33.008412 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:33.008241 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T16:30:32.768989397Z","UUID":"c1cb735f-96ab-440c-b813-1805c321ea68","Handler":null,"Name":"","Endpoint":""} Jul 14 16:30:33.009628 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:33.009611 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 16:30:33.009715 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:33.009647 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 16:30:33.481869 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:33.481697 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:33.481869 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:33.481713 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:33.481869 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:33.481825 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:33.482191 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:33.481964 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:33.581456 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:33.581423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" event={"ID":"58eb7529d0ca1f7fbba34204ef0f772b","Type":"ContainerStarted","Data":"d5ed05fd63f375932c2f0636a75426248a3dd162732d8c296419b830f4cade2f"} Jul 14 16:30:33.583418 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:33.583377 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" event={"ID":"f7382797-711d-41fd-b5cd-ca4b0ddc1060","Type":"ContainerStarted","Data":"7f3b6e16687d63080966d16bf9dbedbea369bcc2c511d3243db1e9db4e887e89"} Jul 14 16:30:33.600813 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:33.600766 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" podStartSLOduration=23.600749279 podStartE2EDuration="23.600749279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:33.600133904 +0000 UTC m=+24.461523188" watchObservedRunningTime="2026-07-14 16:30:33.600749279 +0000 UTC m=+24.462138563" Jul 14 16:30:34.481859 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:34.481828 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:34.482050 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:34.481956 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:34.588496 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:34.588404 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" event={"ID":"f7382797-711d-41fd-b5cd-ca4b0ddc1060","Type":"ContainerStarted","Data":"82c3dd0638a1ac732789c27c760ed97484ca32ba7c4f3a62a65137acd1ee444a"} Jul 14 16:30:34.592063 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:34.592029 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" event={"ID":"91eee248-1cb7-4b9d-b91e-7fec2a5fddef","Type":"ContainerStarted","Data":"92848ad4496107325a98e09c50841db7f2072ca5335bb8882f28c550e2138f10"} Jul 14 16:30:34.612367 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:34.612311 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47xhw" podStartSLOduration=12.365586418 podStartE2EDuration="24.612292644s" totalImagesPullingTime="12.246706226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:34.611654864 +0000 UTC m=+25.473044148" watchObservedRunningTime="2026-07-14 16:30:34.612292644 +0000 UTC m=+25.473681930" Jul 14 16:30:35.481589 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:35.481552 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:35.481761 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:35.481573 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:35.481761 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:35.481691 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:35.481875 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:35.481801 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:36.481878 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:36.481632 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:36.482265 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:36.481983 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:37.481609 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:37.481568 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:37.481795 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:37.481568 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:37.481795 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:37.481687 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:37.481795 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:37.481784 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:37.602487 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:37.602267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" event={"ID":"91eee248-1cb7-4b9d-b91e-7fec2a5fddef","Type":"ContainerStarted","Data":"a9990f2b8cba300c58b8d04b6439c8edbefa8081daea6fb17e4b765dc8d22e4b"} Jul 14 16:30:37.603351 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:37.602550 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:37.604192 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:37.604164 2564 generic.go:356] "Generic (PLEG): container finished" podID="37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c" containerID="c7c34ace947825abb566397eb5c7629bf3e443785e94fd04e9aad08914ac989a" exitCode=0 Jul 14 16:30:37.604314 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:37.604196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-66fch" event={"ID":"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c","Type":"ContainerDied","Data":"c7c34ace947825abb566397eb5c7629bf3e443785e94fd04e9aad08914ac989a"} Jul 14 16:30:37.618985 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:37.618954 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:37.636239 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:37.636193 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" podStartSLOduration=8.146180926 podStartE2EDuration="27.636178989s" totalImagesPullingTime="19.489998063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:37.635536915 +0000 UTC m=+28.496926199" watchObservedRunningTime="2026-07-14 16:30:37.636178989 +0000 UTC m=+28.497568272" Jul 14 16:30:38.482329 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.482291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:38.482486 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:38.482440 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:38.610325 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.610237 2564 generic.go:356] "Generic (PLEG): container finished" podID="37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c" containerID="82ad354ef62e9465d3f4aaecf33e81404d95db562a2df81debc9361688600f9a" exitCode=0 Jul 14 16:30:38.610325 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.610282 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-66fch" event={"ID":"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c","Type":"ContainerDied","Data":"82ad354ef62e9465d3f4aaecf33e81404d95db562a2df81debc9361688600f9a"} Jul 14 16:30:38.610951 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.610926 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:38.611058 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.611016 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:38.628128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.628095 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:30:38.849020 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.848988 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-snds6"] Jul 14 16:30:38.849220 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.849133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:38.849263 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:38.849219 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:38.851999 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.851971 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gnjbs"] Jul 14 16:30:38.852143 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.852083 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:38.852216 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:38.852190 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:38.852617 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.852595 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lqnfn"] Jul 14 16:30:38.852693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:38.852682 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:38.852769 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:38.852750 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:39.615507 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:39.615422 2564 generic.go:356] "Generic (PLEG): container finished" podID="37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c" containerID="eb57571638df66fa97da49fdd88fb986312f1320531f4d2350219143ef817384" exitCode=0 Jul 14 16:30:39.615955 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:39.615504 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-66fch" event={"ID":"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c","Type":"ContainerDied","Data":"eb57571638df66fa97da49fdd88fb986312f1320531f4d2350219143ef817384"} Jul 14 16:30:40.482997 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:40.482972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:40.483103 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:40.483074 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:40.483172 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:40.483144 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:40.483255 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:40.483237 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:40.483295 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:40.483276 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:40.483352 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:40.483336 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:42.482750 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:42.482534 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:42.483192 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:42.482534 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:42.483192 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:42.482855 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:42.483192 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:42.482580 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:42.483192 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:42.482921 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:42.483192 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:42.483016 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:43.342481 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:43.342397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:43.342481 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:43.342470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:43.342761 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:43.342611 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:43.342761 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:43.342625 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:43.342761 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:43.342678 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret podName:dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:15.34266088 +0000 UTC m=+66.204050147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret") pod "global-pull-secret-syncer-snds6" (UID: "dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:43.342761 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:43.342699 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs podName:c736041f-ea1d-4f32-a0a1-4a6a708c9257 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:15.342688368 +0000 UTC m=+66.204077632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs") pod "network-metrics-daemon-gnjbs" (UID: "c736041f-ea1d-4f32-a0a1-4a6a708c9257") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:43.443612 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:43.443579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr6bb\" (UniqueName: \"kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb\") pod \"network-check-target-lqnfn\" (UID: \"5ea99c9e-73c9-4d79-815b-b0d0473ec652\") " pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:43.443797 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:43.443752 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:30:43.443797 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:43.443771 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:30:43.443797 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:43.443781 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jr6bb for pod openshift-network-diagnostics/network-check-target-lqnfn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:43.443942 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:43.443836 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb podName:5ea99c9e-73c9-4d79-815b-b0d0473ec652 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:15.443820353 +0000 UTC m=+66.305209634 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr6bb" (UniqueName: "kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb") pod "network-check-target-lqnfn" (UID: "5ea99c9e-73c9-4d79-815b-b0d0473ec652") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:44.482124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:44.482038 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:44.482567 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:44.482038 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:44.482567 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:44.482159 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnjbs" podUID="c736041f-ea1d-4f32-a0a1-4a6a708c9257" Jul 14 16:30:44.482567 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:44.482248 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snds6" podUID="dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0" Jul 14 16:30:44.482567 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:44.482037 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:44.482567 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:44.482368 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqnfn" podUID="5ea99c9e-73c9-4d79-815b-b0d0473ec652" Jul 14 16:30:44.628870 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:44.628828 2564 generic.go:356] "Generic (PLEG): container finished" podID="37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c" containerID="872b2d24810a1994c14f13023d5d66c9580150f4c3cebd5242deacb088ecf28e" exitCode=0 Jul 14 16:30:44.628870 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:44.628855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-66fch" event={"ID":"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c","Type":"ContainerDied","Data":"872b2d24810a1994c14f13023d5d66c9580150f4c3cebd5242deacb088ecf28e"} Jul 14 16:30:45.042828 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.042754 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeReady" Jul 14 16:30:45.042970 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.042884 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 16:30:45.123298 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.123262 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c559779dc-9d5hb"] Jul 14 16:30:45.137939 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.137910 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.142497 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.142477 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 16:30:45.142894 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.142865 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 16:30:45.143000 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.142960 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l67zw\"" Jul 14 16:30:45.146044 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.146011 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c559779dc-9d5hb"] Jul 14 16:30:45.149039 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.149021 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 16:30:45.149133 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.149058 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 16:30:45.152211 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.152191 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fph2g"] Jul 14 16:30:45.171870 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.171836 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tlwtx"] Jul 14 16:30:45.172032 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.171952 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.176925 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.176904 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 16:30:45.177061 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.177045 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 16:30:45.177127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.177115 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 16:30:45.177373 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.177350 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 16:30:45.177497 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.177437 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbmcg\"" Jul 14 16:30:45.198060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.198039 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fph2g"] Jul 14 16:30:45.198205 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.198076 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tlwtx"] Jul 14 16:30:45.198205 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.198097 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9bkj9"] Jul 14 16:30:45.198205 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.198110 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.200640 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.200620 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 16:30:45.200640 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.200639 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 16:30:45.200871 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.200858 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jq9rg\"" Jul 14 16:30:45.214017 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.213992 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9bkj9"] Jul 14 16:30:45.214147 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.214025 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86"] Jul 14 16:30:45.214147 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.214118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9bkj9" Jul 14 16:30:45.216958 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.216936 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 16:30:45.217274 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.217258 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 16:30:45.217348 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.217320 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 16:30:45.217348 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.217330 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tkzdw\"" Jul 14 16:30:45.232064 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.232037 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86"] Jul 14 16:30:45.232171 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.232123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86" Jul 14 16:30:45.238764 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.238653 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pl4ct\"" Jul 14 16:30:45.238923 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.238907 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 16:30:45.239287 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.239269 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 16:30:45.256785 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.256764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-data-volume\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.256893 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.256791 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900-cert\") pod \"ingress-canary-9bkj9\" (UID: \"ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900\") " pod="openshift-ingress-canary/ingress-canary-9bkj9" Jul 14 16:30:45.256893 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.256808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7w9p\" (UniqueName: \"kubernetes.io/projected/ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900-kube-api-access-b7w9p\") pod \"ingress-canary-9bkj9\" (UID: \"ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900\") " pod="openshift-ingress-canary/ingress-canary-9bkj9" Jul 14 16:30:45.256893 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.256825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.256893 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.256840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e1ba60b-db2a-4b86-b3c1-5f302158c983-config-volume\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.257033 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.256948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-crio-socket\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.257033 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.256970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-bound-sa-token\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.257033 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.256987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlg9b\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-kube-api-access-dlg9b\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.257033 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257007 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-trusted-ca\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.257033 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tdnp\" (UniqueName: \"kubernetes.io/projected/9e1ba60b-db2a-4b86-b3c1-5f302158c983-kube-api-access-8tdnp\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.257187 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257055 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.257187 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-image-registry-private-configuration\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.257187 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-installation-pull-secrets\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.257187 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t96lm\" (UniqueName: \"kubernetes.io/projected/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-api-access-t96lm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.257187 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1745bf3-fb14-4913-a3ad-391a164a11a9-ca-trust-extracted\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.257351 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.257351 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257216 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba60b-db2a-4b86-b3c1-5f302158c983-tmp-dir\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.257351 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-certificates\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.257351 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.257258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.357881 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.357786 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-certificates\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.357881 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.357823 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.357881 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.357846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm5tq\" (UniqueName: \"kubernetes.io/projected/dca7ab74-eabe-4550-a202-cc4ad25e1142-kube-api-access-tm5tq\") pod \"migrator-7f59b54f6c-vjv86\" (UID: \"dca7ab74-eabe-4550-a202-cc4ad25e1142\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86" Jul 14 16:30:45.358131 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.357915 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 16:30:45.358131 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.357928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-data-volume\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.358131 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.357961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900-cert\") pod \"ingress-canary-9bkj9\" (UID: \"ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900\") " pod="openshift-ingress-canary/ingress-canary-9bkj9" Jul 14 16:30:45.358131 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.357995 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm podName:09ca01b7-a9db-4fa3-a8d6-512877ad90aa nodeName:}" failed. No retries permitted until 2026-07-14 16:30:45.857974409 +0000 UTC m=+36.719363689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fph2g" (UID: "09ca01b7-a9db-4fa3-a8d6-512877ad90aa") : configmap "kube-rbac-proxy" not found Jul 14 16:30:45.358131 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7w9p\" (UniqueName: \"kubernetes.io/projected/ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900-kube-api-access-b7w9p\") pod \"ingress-canary-9bkj9\" (UID: \"ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900\") " pod="openshift-ingress-canary/ingress-canary-9bkj9" Jul 14 16:30:45.358131 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.358131 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e1ba60b-db2a-4b86-b3c1-5f302158c983-config-volume\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.358131 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-crio-socket\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.358530 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-bound-sa-token\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.358530 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlg9b\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-kube-api-access-dlg9b\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.358530 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-trusted-ca\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.358530 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.358206 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:45.358530 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.358223 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c559779dc-9d5hb: secret "image-registry-tls" not found Jul 14 16:30:45.358530 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.358273 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls podName:f1745bf3-fb14-4913-a3ad-391a164a11a9 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:45.858255344 +0000 UTC m=+36.719644610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls") pod "image-registry-5c559779dc-9d5hb" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9") : secret "image-registry-tls" not found Jul 14 16:30:45.358530 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tdnp\" (UniqueName: \"kubernetes.io/projected/9e1ba60b-db2a-4b86-b3c1-5f302158c983-kube-api-access-8tdnp\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.358530 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.358530 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-image-registry-private-configuration\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.358530 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-installation-pull-secrets\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t96lm\" (UniqueName: \"kubernetes.io/projected/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-api-access-t96lm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1745bf3-fb14-4913-a3ad-391a164a11a9-ca-trust-extracted\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358592 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-certificates\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba60b-db2a-4b86-b3c1-5f302158c983-tmp-dir\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358539 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-crio-socket\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.358676 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358707 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e1ba60b-db2a-4b86-b3c1-5f302158c983-config-volume\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.358732 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls podName:09ca01b7-a9db-4fa3-a8d6-512877ad90aa nodeName:}" failed. No retries permitted until 2026-07-14 16:30:45.858718566 +0000 UTC m=+36.720107844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fph2g" (UID: "09ca01b7-a9db-4fa3-a8d6-512877ad90aa") : secret "insights-runtime-extractor-tls" not found Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.358732 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.358767 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls podName:9e1ba60b-db2a-4b86-b3c1-5f302158c983 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:45.858756976 +0000 UTC m=+36.720146243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls") pod "dns-default-tlwtx" (UID: "9e1ba60b-db2a-4b86-b3c1-5f302158c983") : secret "dns-default-metrics-tls" not found Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358966 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1745bf3-fb14-4913-a3ad-391a164a11a9-ca-trust-extracted\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.359019 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.358966 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba60b-db2a-4b86-b3c1-5f302158c983-tmp-dir\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.359588 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.359145 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-data-volume\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.359588 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.359183 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-trusted-ca\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.362430 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.362406 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-installation-pull-secrets\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.362430 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.362423 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900-cert\") pod \"ingress-canary-9bkj9\" (UID: \"ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900\") " pod="openshift-ingress-canary/ingress-canary-9bkj9" Jul 14 16:30:45.362574 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.362407 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-image-registry-private-configuration\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.370401 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.370362 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t96lm\" (UniqueName: \"kubernetes.io/projected/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-api-access-t96lm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.372576 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.372552 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tdnp\" (UniqueName: \"kubernetes.io/projected/9e1ba60b-db2a-4b86-b3c1-5f302158c983-kube-api-access-8tdnp\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.373167 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.373140 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-bound-sa-token\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.373710 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.373688 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlg9b\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-kube-api-access-dlg9b\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.373864 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.373844 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7w9p\" (UniqueName: \"kubernetes.io/projected/ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900-kube-api-access-b7w9p\") pod \"ingress-canary-9bkj9\" (UID: \"ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900\") " pod="openshift-ingress-canary/ingress-canary-9bkj9" Jul 14 16:30:45.459162 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.459121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm5tq\" (UniqueName: \"kubernetes.io/projected/dca7ab74-eabe-4550-a202-cc4ad25e1142-kube-api-access-tm5tq\") pod \"migrator-7f59b54f6c-vjv86\" (UID: \"dca7ab74-eabe-4550-a202-cc4ad25e1142\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86" Jul 14 16:30:45.469499 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.469471 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm5tq\" (UniqueName: \"kubernetes.io/projected/dca7ab74-eabe-4550-a202-cc4ad25e1142-kube-api-access-tm5tq\") pod \"migrator-7f59b54f6c-vjv86\" (UID: \"dca7ab74-eabe-4550-a202-cc4ad25e1142\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86" Jul 14 16:30:45.522640 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.522610 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9bkj9" Jul 14 16:30:45.540939 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.540910 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86" Jul 14 16:30:45.563006 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.562982 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qjts_68ac6474-3dc9-46a3-95ce-19a2210f461e/dns-node-resolver/0.log" Jul 14 16:30:45.634712 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.634625 2564 generic.go:356] "Generic (PLEG): container finished" podID="37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c" containerID="16ac852a2253761dd509a312020674212b44a151da72940054222446d8bc9d4a" exitCode=0 Jul 14 16:30:45.634712 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.634684 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-66fch" event={"ID":"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c","Type":"ContainerDied","Data":"16ac852a2253761dd509a312020674212b44a151da72940054222446d8bc9d4a"} Jul 14 16:30:45.735785 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.735550 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86"] Jul 14 16:30:45.739414 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.739363 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9bkj9"] Jul 14 16:30:45.740573 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:45.740547 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca7ab74_eabe_4550_a202_cc4ad25e1142.slice/crio-39aaea62f1941ee051b276ba4d46d4264653de6fec9dd38b07cde0a17102eb92 WatchSource:0}: Error finding container 39aaea62f1941ee051b276ba4d46d4264653de6fec9dd38b07cde0a17102eb92: Status 404 returned error can't find the container with id 39aaea62f1941ee051b276ba4d46d4264653de6fec9dd38b07cde0a17102eb92 Jul 14 16:30:45.742802 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:30:45.742779 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebbd65a7_ace1_4d2b_a5b0_7fac0ab99900.slice/crio-7d5f64a41adee4ce28a9961d61be8700bf223b35d74e5df4ee96a16b402b8258 WatchSource:0}: Error finding container 7d5f64a41adee4ce28a9961d61be8700bf223b35d74e5df4ee96a16b402b8258: Status 404 returned error can't find the container with id 7d5f64a41adee4ce28a9961d61be8700bf223b35d74e5df4ee96a16b402b8258 Jul 14 16:30:45.865324 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.865288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:45.865556 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.865365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.865556 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.865427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:45.865556 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:45.865460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:45.865556 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.865473 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:45.865556 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.865490 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c559779dc-9d5hb: secret "image-registry-tls" not found Jul 14 16:30:45.865556 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.865516 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:30:45.865556 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.865538 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:45.865556 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.865550 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls podName:f1745bf3-fb14-4913-a3ad-391a164a11a9 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:46.865529913 +0000 UTC m=+37.726919190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls") pod "image-registry-5c559779dc-9d5hb" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9") : secret "image-registry-tls" not found Jul 14 16:30:45.865853 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.865570 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls podName:09ca01b7-a9db-4fa3-a8d6-512877ad90aa nodeName:}" failed. No retries permitted until 2026-07-14 16:30:46.865556971 +0000 UTC m=+37.726946232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fph2g" (UID: "09ca01b7-a9db-4fa3-a8d6-512877ad90aa") : secret "insights-runtime-extractor-tls" not found Jul 14 16:30:45.865853 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.865543 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 16:30:45.865853 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.865583 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls podName:9e1ba60b-db2a-4b86-b3c1-5f302158c983 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:46.86557735 +0000 UTC m=+37.726966611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls") pod "dns-default-tlwtx" (UID: "9e1ba60b-db2a-4b86-b3c1-5f302158c983") : secret "dns-default-metrics-tls" not found Jul 14 16:30:45.865853 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:45.865636 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm podName:09ca01b7-a9db-4fa3-a8d6-512877ad90aa nodeName:}" failed. No retries permitted until 2026-07-14 16:30:46.865620409 +0000 UTC m=+37.727009670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fph2g" (UID: "09ca01b7-a9db-4fa3-a8d6-512877ad90aa") : configmap "kube-rbac-proxy" not found Jul 14 16:30:46.481991 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.481955 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:30:46.482169 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.482067 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:30:46.482169 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.482102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:30:46.486070 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.486045 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 16:30:46.486865 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.486526 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 16:30:46.487504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.487480 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2hfc\"" Jul 14 16:30:46.487595 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.487532 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cr5gm\"" Jul 14 16:30:46.487595 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.487584 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 16:30:46.493980 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.493962 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 16:30:46.640900 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.640854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-66fch" event={"ID":"37299eaa-8cfa-43e0-9c5f-8b84a48cbe4c","Type":"ContainerStarted","Data":"f6af96d637476cace5cc346a87e993ad3c9279c4738b00b01396cb44d8bcddb1"} Jul 14 16:30:46.642017 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.641995 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86" event={"ID":"dca7ab74-eabe-4550-a202-cc4ad25e1142","Type":"ContainerStarted","Data":"39aaea62f1941ee051b276ba4d46d4264653de6fec9dd38b07cde0a17102eb92"} Jul 14 16:30:46.642986 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.642960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9bkj9" event={"ID":"ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900","Type":"ContainerStarted","Data":"7d5f64a41adee4ce28a9961d61be8700bf223b35d74e5df4ee96a16b402b8258"} Jul 14 16:30:46.670508 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.670461 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-66fch" podStartSLOduration=12.962025392 podStartE2EDuration="36.670444571s" totalImagesPullingTime="23.708419179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:46.669300634 +0000 UTC m=+37.530689929" watchObservedRunningTime="2026-07-14 16:30:46.670444571 +0000 UTC m=+37.531833856" Jul 14 16:30:46.873596 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.873503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:46.873596 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.873548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:46.873596 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.873573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:46.873868 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.873623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:46.873868 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:46.873680 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:46.873868 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:46.873732 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 16:30:46.873868 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:46.873748 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:46.873868 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:46.873680 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:30:46.873868 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:46.873763 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c559779dc-9d5hb: secret "image-registry-tls" not found Jul 14 16:30:46.873868 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:46.873745 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls podName:9e1ba60b-db2a-4b86-b3c1-5f302158c983 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:48.87372584 +0000 UTC m=+39.735115124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls") pod "dns-default-tlwtx" (UID: "9e1ba60b-db2a-4b86-b3c1-5f302158c983") : secret "dns-default-metrics-tls" not found Jul 14 16:30:46.873868 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:46.873804 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls podName:09ca01b7-a9db-4fa3-a8d6-512877ad90aa nodeName:}" failed. No retries permitted until 2026-07-14 16:30:48.873794764 +0000 UTC m=+39.735184038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fph2g" (UID: "09ca01b7-a9db-4fa3-a8d6-512877ad90aa") : secret "insights-runtime-extractor-tls" not found Jul 14 16:30:46.873868 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:46.873814 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls podName:f1745bf3-fb14-4913-a3ad-391a164a11a9 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:48.873809025 +0000 UTC m=+39.735198286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls") pod "image-registry-5c559779dc-9d5hb" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9") : secret "image-registry-tls" not found Jul 14 16:30:46.873868 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:46.873824 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm podName:09ca01b7-a9db-4fa3-a8d6-512877ad90aa nodeName:}" failed. No retries permitted until 2026-07-14 16:30:48.873819066 +0000 UTC m=+39.735208328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fph2g" (UID: "09ca01b7-a9db-4fa3-a8d6-512877ad90aa") : configmap "kube-rbac-proxy" not found Jul 14 16:30:46.901313 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:46.901289 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wvd67_8441833e-789c-4a31-ab22-3ad366b2b974/node-ca/0.log" Jul 14 16:30:48.890162 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:48.890124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:48.890183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:48.890217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:48.890274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:48.890286 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:48.890360 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls podName:09ca01b7-a9db-4fa3-a8d6-512877ad90aa nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.890340153 +0000 UTC m=+43.751729436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fph2g" (UID: "09ca01b7-a9db-4fa3-a8d6-512877ad90aa") : secret "insights-runtime-extractor-tls" not found Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:48.890364 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:48.890414 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:48.890430 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c559779dc-9d5hb: secret "image-registry-tls" not found Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:48.890458 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls podName:9e1ba60b-db2a-4b86-b3c1-5f302158c983 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.89044018 +0000 UTC m=+43.751829463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls") pod "dns-default-tlwtx" (UID: "9e1ba60b-db2a-4b86-b3c1-5f302158c983") : secret "dns-default-metrics-tls" not found Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:48.890371 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:48.890479 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls podName:f1745bf3-fb14-4913-a3ad-391a164a11a9 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.890469685 +0000 UTC m=+43.751858946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls") pod "image-registry-5c559779dc-9d5hb" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9") : secret "image-registry-tls" not found Jul 14 16:30:48.890596 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:48.890528 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm podName:09ca01b7-a9db-4fa3-a8d6-512877ad90aa nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.890504005 +0000 UTC m=+43.751893271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fph2g" (UID: "09ca01b7-a9db-4fa3-a8d6-512877ad90aa") : configmap "kube-rbac-proxy" not found Jul 14 16:30:50.653949 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:50.653914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86" event={"ID":"dca7ab74-eabe-4550-a202-cc4ad25e1142","Type":"ContainerStarted","Data":"70d7c1aca46267a9b36b9d244f286058696cc36ee7a3e5edf609888dd3657450"} Jul 14 16:30:50.654407 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:50.653975 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86" event={"ID":"dca7ab74-eabe-4550-a202-cc4ad25e1142","Type":"ContainerStarted","Data":"a21ddf66fd7015b4ddc377d99515f8abf815b921cf652ff11c016e40a3701818"} Jul 14 16:30:50.655457 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:50.655431 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9bkj9" event={"ID":"ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900","Type":"ContainerStarted","Data":"936d5b857fe239d11e1d761d6cd9fd4e369785e4f78e112e9d9c41fe349a4735"} Jul 14 16:30:50.768530 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:50.768419 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vjv86" podStartSLOduration=1.275188873 podStartE2EDuration="5.768378842s" totalImagesPullingTime="4.493189969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:50.765789777 +0000 UTC m=+41.627179060" watchObservedRunningTime="2026-07-14 16:30:50.768378842 +0000 UTC m=+41.629768125" Jul 14 16:30:52.921447 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:52.921405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:52.921468 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:52.921541 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:52.921578 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:52.921588 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c559779dc-9d5hb: secret "image-registry-tls" not found Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:52.921624 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm podName:09ca01b7-a9db-4fa3-a8d6-512877ad90aa nodeName:}" failed. No retries permitted until 2026-07-14 16:31:00.921600741 +0000 UTC m=+51.782990008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fph2g" (UID: "09ca01b7-a9db-4fa3-a8d6-512877ad90aa") : configmap "kube-rbac-proxy" not found Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:52.921652 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:52.921702 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls podName:f1745bf3-fb14-4913-a3ad-391a164a11a9 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:00.921691213 +0000 UTC m=+51.783080476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls") pod "image-registry-5c559779dc-9d5hb" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9") : secret "image-registry-tls" not found Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:52.921749 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:30:52.921777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:52.921794 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls podName:09ca01b7-a9db-4fa3-a8d6-512877ad90aa nodeName:}" failed. No retries permitted until 2026-07-14 16:31:00.921781031 +0000 UTC m=+51.783170292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fph2g" (UID: "09ca01b7-a9db-4fa3-a8d6-512877ad90aa") : secret "insights-runtime-extractor-tls" not found Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:52.921823 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:52.921913 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:30:52.921847 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls podName:9e1ba60b-db2a-4b86-b3c1-5f302158c983 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:00.921838158 +0000 UTC m=+51.783227418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls") pod "dns-default-tlwtx" (UID: "9e1ba60b-db2a-4b86-b3c1-5f302158c983") : secret "dns-default-metrics-tls" not found Jul 14 16:31:00.985207 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:00.985166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:31:00.985207 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:00.985210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:31:00.985678 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:00.985233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:31:00.985678 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:00.985270 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:31:00.985895 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:00.985866 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:31:00.988874 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:00.988851 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09ca01b7-a9db-4fa3-a8d6-512877ad90aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fph2g\" (UID: \"09ca01b7-a9db-4fa3-a8d6-512877ad90aa\") " pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:31:00.988994 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:00.988937 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1ba60b-db2a-4b86-b3c1-5f302158c983-metrics-tls\") pod \"dns-default-tlwtx\" (UID: \"9e1ba60b-db2a-4b86-b3c1-5f302158c983\") " pod="openshift-dns/dns-default-tlwtx" Jul 14 16:31:00.989115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:00.989099 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls\") pod \"image-registry-5c559779dc-9d5hb\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:31:01.046985 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.046943 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:31:01.080766 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.080733 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fph2g" Jul 14 16:31:01.110233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.110195 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlwtx" Jul 14 16:31:01.211518 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.210347 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9bkj9" podStartSLOduration=11.720903316 podStartE2EDuration="16.210326992s" totalImagesPullingTime="4.489423676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:50.80966187 +0000 UTC m=+41.671051153" watchObservedRunningTime="2026-07-14 16:31:01.210326992 +0000 UTC m=+52.071716276" Jul 14 16:31:01.211518 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.211451 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c559779dc-9d5hb"] Jul 14 16:31:01.215859 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:01.215825 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1745bf3_fb14_4913_a3ad_391a164a11a9.slice/crio-6906af25f76cf8d34597d795ed1b336f899bfab03f8dc020258083f252e64927 WatchSource:0}: Error finding container 6906af25f76cf8d34597d795ed1b336f899bfab03f8dc020258083f252e64927: Status 404 returned error can't find the container with id 6906af25f76cf8d34597d795ed1b336f899bfab03f8dc020258083f252e64927 Jul 14 16:31:01.236531 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.236468 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fph2g"] Jul 14 16:31:01.239556 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:01.239515 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ca01b7_a9db_4fa3_a8d6_512877ad90aa.slice/crio-8acb7ccb400d82ec54adb9072860dff9e7bf96c8539738cf90295f85f419e9b0 WatchSource:0}: Error finding container 8acb7ccb400d82ec54adb9072860dff9e7bf96c8539738cf90295f85f419e9b0: Status 404 returned error can't find the container with id 8acb7ccb400d82ec54adb9072860dff9e7bf96c8539738cf90295f85f419e9b0 Jul 14 16:31:01.280766 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.280738 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tlwtx"] Jul 14 16:31:01.284364 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:01.284342 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1ba60b_db2a_4b86_b3c1_5f302158c983.slice/crio-5330b65062ed504a4ea1662e8d1ad200023ca439f6ecf60531de28c99d7e6497 WatchSource:0}: Error finding container 5330b65062ed504a4ea1662e8d1ad200023ca439f6ecf60531de28c99d7e6497: Status 404 returned error can't find the container with id 5330b65062ed504a4ea1662e8d1ad200023ca439f6ecf60531de28c99d7e6497 Jul 14 16:31:01.683527 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.683484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" event={"ID":"f1745bf3-fb14-4913-a3ad-391a164a11a9","Type":"ContainerStarted","Data":"c8b82715c6f3179b3a0d8d5794e7253e9213c44a807b63fe3b5431eb9925aa3b"} Jul 14 16:31:01.683704 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.683555 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" event={"ID":"f1745bf3-fb14-4913-a3ad-391a164a11a9","Type":"ContainerStarted","Data":"6906af25f76cf8d34597d795ed1b336f899bfab03f8dc020258083f252e64927"} Jul 14 16:31:01.683704 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.683598 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:31:01.685126 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.685100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fph2g" event={"ID":"09ca01b7-a9db-4fa3-a8d6-512877ad90aa","Type":"ContainerStarted","Data":"8acb7ccb400d82ec54adb9072860dff9e7bf96c8539738cf90295f85f419e9b0"} Jul 14 16:31:01.687564 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.687538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlwtx" event={"ID":"9e1ba60b-db2a-4b86-b3c1-5f302158c983","Type":"ContainerStarted","Data":"5330b65062ed504a4ea1662e8d1ad200023ca439f6ecf60531de28c99d7e6497"} Jul 14 16:31:01.712745 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:01.712477 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" podStartSLOduration=25.712456563 podStartE2EDuration="25.712456563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:01.711550997 +0000 UTC m=+52.572940282" watchObservedRunningTime="2026-07-14 16:31:01.712456563 +0000 UTC m=+52.573845851" Jul 14 16:31:05.703240 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:05.703207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fph2g" event={"ID":"09ca01b7-a9db-4fa3-a8d6-512877ad90aa","Type":"ContainerStarted","Data":"37a3d8bb581a04fc93770785d0e304ca79bd073f3c307e786951b5d2c32f4273"} Jul 14 16:31:05.704879 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:05.704854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlwtx" event={"ID":"9e1ba60b-db2a-4b86-b3c1-5f302158c983","Type":"ContainerStarted","Data":"5dcf41f3a53af859ea6f2e3e8d018732767a12bc24f20067d2746e9dce885b8c"} Jul 14 16:31:05.705000 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:05.704902 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlwtx" event={"ID":"9e1ba60b-db2a-4b86-b3c1-5f302158c983","Type":"ContainerStarted","Data":"d67aee13d65139bf6cb6b695675b65d2b995be590f69d4be2f96d5ccdfbd4fca"} Jul 14 16:31:05.705000 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:05.704977 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tlwtx" Jul 14 16:31:05.727002 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:05.726962 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tlwtx" podStartSLOduration=16.634982754 podStartE2EDuration="20.72694908s" totalImagesPullingTime="4.091966326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:05.726331592 +0000 UTC m=+56.587720877" watchObservedRunningTime="2026-07-14 16:31:05.72694908 +0000 UTC m=+56.588338363" Jul 14 16:31:06.710458 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:06.710418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fph2g" event={"ID":"09ca01b7-a9db-4fa3-a8d6-512877ad90aa","Type":"ContainerStarted","Data":"88e048575dac55f1556bfe4d074dedc1047990ec039637ea89b934653e1027c1"} Jul 14 16:31:09.722247 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:09.722207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fph2g" event={"ID":"09ca01b7-a9db-4fa3-a8d6-512877ad90aa","Type":"ContainerStarted","Data":"aa0f8e5db587cb426b64d261208507fddc7afb1970826020b616f72c1da82676"} Jul 14 16:31:09.743303 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:09.743256 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fph2g" podStartSLOduration=17.208985101 podStartE2EDuration="24.743243179s" totalImagesPullingTime="7.534258078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:09.742493513 +0000 UTC m=+60.603882797" watchObservedRunningTime="2026-07-14 16:31:09.743243179 +0000 UTC m=+60.604632462" Jul 14 16:31:10.086678 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.086604 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c559779dc-9d5hb"] Jul 14 16:31:10.125971 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.125941 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-jsf6w"] Jul 14 16:31:10.129867 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.129848 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4xn4t"] Jul 14 16:31:10.129985 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.129968 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-jsf6w" Jul 14 16:31:10.132557 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.132538 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" Jul 14 16:31:10.132740 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.132719 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 16:31:10.133020 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.133004 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-skcdz\"" Jul 14 16:31:10.133084 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.133032 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 16:31:10.135128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.135109 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4nj2p\"" Jul 14 16:31:10.135500 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.135480 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 14 16:31:10.135711 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.135698 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 14 16:31:10.149180 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.149162 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4xn4t"] Jul 14 16:31:10.149902 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.149884 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-jsf6w"] Jul 14 16:31:10.232871 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.232849 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b9c5d9b75-jv97z"] Jul 14 16:31:10.235673 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.235659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.251254 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.251224 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f88dd9f97-kdkd6"] Jul 14 16:31:10.253338 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.253319 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 16:31:10.253438 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.253321 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 16:31:10.253578 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.253564 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-npk6x\"" Jul 14 16:31:10.254007 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.253990 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.256792 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.256778 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 16:31:10.258474 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.258450 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 16:31:10.265220 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.265192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a93af83-7f49-4e78-98d5-d25a838926b2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xn4t\" (UID: \"2a93af83-7f49-4e78-98d5-d25a838926b2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" Jul 14 16:31:10.265301 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.265244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lnqn\" (UniqueName: \"kubernetes.io/projected/84db6128-6bbe-45af-a180-f48a5f6d9dce-kube-api-access-2lnqn\") pod \"downloads-68c9cbb497-jsf6w\" (UID: \"84db6128-6bbe-45af-a180-f48a5f6d9dce\") " pod="openshift-console/downloads-68c9cbb497-jsf6w" Jul 14 16:31:10.265393 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.265302 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a93af83-7f49-4e78-98d5-d25a838926b2-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4xn4t\" (UID: \"2a93af83-7f49-4e78-98d5-d25a838926b2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" Jul 14 16:31:10.276895 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.276878 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 16:31:10.293100 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.293081 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9c5d9b75-jv97z"] Jul 14 16:31:10.314357 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.314332 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f88dd9f97-kdkd6"] Jul 14 16:31:10.365728 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.365655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a93af83-7f49-4e78-98d5-d25a838926b2-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4xn4t\" (UID: \"2a93af83-7f49-4e78-98d5-d25a838926b2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" Jul 14 16:31:10.365728 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.365690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-oauth-serving-cert\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.365728 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.365717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/314f3137-6e1a-43e4-a5b9-6585710c31e0-installation-pull-secrets\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.365929 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.365753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lnqn\" (UniqueName: \"kubernetes.io/projected/84db6128-6bbe-45af-a180-f48a5f6d9dce-kube-api-access-2lnqn\") pod \"downloads-68c9cbb497-jsf6w\" (UID: \"84db6128-6bbe-45af-a180-f48a5f6d9dce\") " pod="openshift-console/downloads-68c9cbb497-jsf6w" Jul 14 16:31:10.365929 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.365885 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk5sw\" (UniqueName: \"kubernetes.io/projected/2f1acf56-4172-4f3b-b1af-54026bc1aa98-kube-api-access-kk5sw\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.366026 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.365927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-oauth-config\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.366026 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.366005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/314f3137-6e1a-43e4-a5b9-6585710c31e0-registry-tls\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.366135 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.366120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a93af83-7f49-4e78-98d5-d25a838926b2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xn4t\" (UID: \"2a93af83-7f49-4e78-98d5-d25a838926b2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" Jul 14 16:31:10.366171 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.366143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/314f3137-6e1a-43e4-a5b9-6585710c31e0-trusted-ca\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.366217 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.366161 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/314f3137-6e1a-43e4-a5b9-6585710c31e0-image-registry-private-configuration\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.366217 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.366187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/314f3137-6e1a-43e4-a5b9-6585710c31e0-registry-certificates\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.366356 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.366343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/314f3137-6e1a-43e4-a5b9-6585710c31e0-bound-sa-token\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.366992 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.366969 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a93af83-7f49-4e78-98d5-d25a838926b2-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4xn4t\" (UID: \"2a93af83-7f49-4e78-98d5-d25a838926b2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" Jul 14 16:31:10.367072 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.367006 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-config\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.367072 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.367059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/314f3137-6e1a-43e4-a5b9-6585710c31e0-ca-trust-extracted\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.367178 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.367128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-serving-cert\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.367178 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.367158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-service-ca\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.367274 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.367183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx289\" (UniqueName: \"kubernetes.io/projected/314f3137-6e1a-43e4-a5b9-6585710c31e0-kube-api-access-sx289\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.370961 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.370887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a93af83-7f49-4e78-98d5-d25a838926b2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4xn4t\" (UID: \"2a93af83-7f49-4e78-98d5-d25a838926b2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" Jul 14 16:31:10.377577 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.377560 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lnqn\" (UniqueName: \"kubernetes.io/projected/84db6128-6bbe-45af-a180-f48a5f6d9dce-kube-api-access-2lnqn\") pod \"downloads-68c9cbb497-jsf6w\" (UID: \"84db6128-6bbe-45af-a180-f48a5f6d9dce\") " pod="openshift-console/downloads-68c9cbb497-jsf6w" Jul 14 16:31:10.440539 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.440510 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-jsf6w" Jul 14 16:31:10.444488 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.444462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" Jul 14 16:31:10.468364 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.468336 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-config\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.468504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.468378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/314f3137-6e1a-43e4-a5b9-6585710c31e0-ca-trust-extracted\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.468504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.468416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-serving-cert\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.468504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.468433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-service-ca\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.468504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.468453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx289\" (UniqueName: \"kubernetes.io/projected/314f3137-6e1a-43e4-a5b9-6585710c31e0-kube-api-access-sx289\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.468504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.468480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-oauth-serving-cert\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.468905 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.468881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/314f3137-6e1a-43e4-a5b9-6585710c31e0-installation-pull-secrets\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.469009 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.468937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk5sw\" (UniqueName: \"kubernetes.io/projected/2f1acf56-4172-4f3b-b1af-54026bc1aa98-kube-api-access-kk5sw\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.469009 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.468982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-oauth-config\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.469009 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.469004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/314f3137-6e1a-43e4-a5b9-6585710c31e0-registry-tls\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.469163 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.469050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/314f3137-6e1a-43e4-a5b9-6585710c31e0-trusted-ca\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.469163 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.469082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/314f3137-6e1a-43e4-a5b9-6585710c31e0-image-registry-private-configuration\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.469163 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.469112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/314f3137-6e1a-43e4-a5b9-6585710c31e0-registry-certificates\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.469307 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.469239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-config\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.469941 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.469472 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-service-ca\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.469941 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.469078 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/314f3137-6e1a-43e4-a5b9-6585710c31e0-ca-trust-extracted\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.469941 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.469598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/314f3137-6e1a-43e4-a5b9-6585710c31e0-bound-sa-token\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.469941 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.469899 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/314f3137-6e1a-43e4-a5b9-6585710c31e0-registry-certificates\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.469941 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.469908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-oauth-serving-cert\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.470762 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.470739 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/314f3137-6e1a-43e4-a5b9-6585710c31e0-trusted-ca\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.471966 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.471933 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-serving-cert\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.472362 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.472344 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/314f3137-6e1a-43e4-a5b9-6585710c31e0-registry-tls\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.472443 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.472357 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-oauth-config\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.472443 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.472413 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/314f3137-6e1a-43e4-a5b9-6585710c31e0-image-registry-private-configuration\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.472513 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.472498 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/314f3137-6e1a-43e4-a5b9-6585710c31e0-installation-pull-secrets\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.479504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.479479 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/314f3137-6e1a-43e4-a5b9-6585710c31e0-bound-sa-token\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.480414 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.480032 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk5sw\" (UniqueName: \"kubernetes.io/projected/2f1acf56-4172-4f3b-b1af-54026bc1aa98-kube-api-access-kk5sw\") pod \"console-b9c5d9b75-jv97z\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.480606 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.480583 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx289\" (UniqueName: \"kubernetes.io/projected/314f3137-6e1a-43e4-a5b9-6585710c31e0-kube-api-access-sx289\") pod \"image-registry-5f88dd9f97-kdkd6\" (UID: \"314f3137-6e1a-43e4-a5b9-6585710c31e0\") " pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.543913 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.543849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:10.561707 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.561683 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:10.577543 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.577504 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-jsf6w"] Jul 14 16:31:10.581737 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:10.581705 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84db6128_6bbe_45af_a180_f48a5f6d9dce.slice/crio-a6f1cde7c49a3f8e237b0dc92e3598b872517a776394061a37fc698a3fe4c5e2 WatchSource:0}: Error finding container a6f1cde7c49a3f8e237b0dc92e3598b872517a776394061a37fc698a3fe4c5e2: Status 404 returned error can't find the container with id a6f1cde7c49a3f8e237b0dc92e3598b872517a776394061a37fc698a3fe4c5e2 Jul 14 16:31:10.595475 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.595430 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4xn4t"] Jul 14 16:31:10.631829 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.631805 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xb9lb" Jul 14 16:31:10.691748 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.691718 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9c5d9b75-jv97z"] Jul 14 16:31:10.694933 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:10.694911 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1acf56_4172_4f3b_b1af_54026bc1aa98.slice/crio-491172df171ca8e85852c278a20ca9cec6e055da3a94e452b71f7fe74210df08 WatchSource:0}: Error finding container 491172df171ca8e85852c278a20ca9cec6e055da3a94e452b71f7fe74210df08: Status 404 returned error can't find the container with id 491172df171ca8e85852c278a20ca9cec6e055da3a94e452b71f7fe74210df08 Jul 14 16:31:10.712653 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.712634 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f88dd9f97-kdkd6"] Jul 14 16:31:10.715099 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:10.715076 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314f3137_6e1a_43e4_a5b9_6585710c31e0.slice/crio-a157f6877815b2a6e9f505f08eb0cbdd6b806f6ac91fd8f9eb0dc64615a3c7a5 WatchSource:0}: Error finding container a157f6877815b2a6e9f505f08eb0cbdd6b806f6ac91fd8f9eb0dc64615a3c7a5: Status 404 returned error can't find the container with id a157f6877815b2a6e9f505f08eb0cbdd6b806f6ac91fd8f9eb0dc64615a3c7a5 Jul 14 16:31:10.725679 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.725654 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" event={"ID":"314f3137-6e1a-43e4-a5b9-6585710c31e0","Type":"ContainerStarted","Data":"a157f6877815b2a6e9f505f08eb0cbdd6b806f6ac91fd8f9eb0dc64615a3c7a5"} Jul 14 16:31:10.726903 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.726875 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9c5d9b75-jv97z" event={"ID":"2f1acf56-4172-4f3b-b1af-54026bc1aa98","Type":"ContainerStarted","Data":"491172df171ca8e85852c278a20ca9cec6e055da3a94e452b71f7fe74210df08"} Jul 14 16:31:10.728018 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.727994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" event={"ID":"2a93af83-7f49-4e78-98d5-d25a838926b2","Type":"ContainerStarted","Data":"dd016678a49e94cc60512cec94a728380c7707c1295c9dae51d6d77af8fe83e8"} Jul 14 16:31:10.729056 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:10.729033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-jsf6w" event={"ID":"84db6128-6bbe-45af-a180-f48a5f6d9dce","Type":"ContainerStarted","Data":"a6f1cde7c49a3f8e237b0dc92e3598b872517a776394061a37fc698a3fe4c5e2"} Jul 14 16:31:11.711011 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.710982 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2"] Jul 14 16:31:11.714163 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.714140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2" Jul 14 16:31:11.717269 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.717237 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6sn5r\"" Jul 14 16:31:11.717536 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.717514 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 14 16:31:11.726061 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.726028 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2"] Jul 14 16:31:11.734368 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.734345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" event={"ID":"314f3137-6e1a-43e4-a5b9-6585710c31e0","Type":"ContainerStarted","Data":"89601e72aea511734dab33ceae26ed603d8e4523eb8e81a7ca2eb496f894d9d3"} Jul 14 16:31:11.734503 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.734487 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:11.795828 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.795782 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" podStartSLOduration=1.795768535 podStartE2EDuration="1.795768535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:11.795584904 +0000 UTC m=+62.656974199" watchObservedRunningTime="2026-07-14 16:31:11.795768535 +0000 UTC m=+62.657157796" Jul 14 16:31:11.880197 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.880166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e4d6d451-46b0-49e2-aa4f-9d86ba8e3850-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-gpdx2\" (UID: \"e4d6d451-46b0-49e2-aa4f-9d86ba8e3850\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2" Jul 14 16:31:11.981342 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.981262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e4d6d451-46b0-49e2-aa4f-9d86ba8e3850-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-gpdx2\" (UID: \"e4d6d451-46b0-49e2-aa4f-9d86ba8e3850\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2" Jul 14 16:31:11.984269 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:11.984239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e4d6d451-46b0-49e2-aa4f-9d86ba8e3850-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-gpdx2\" (UID: \"e4d6d451-46b0-49e2-aa4f-9d86ba8e3850\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2" Jul 14 16:31:12.024523 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:12.024481 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2" Jul 14 16:31:12.182414 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:12.181971 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2"] Jul 14 16:31:12.187247 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:12.187215 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d6d451_46b0_49e2_aa4f_9d86ba8e3850.slice/crio-1d2111b027db2f902f6ca2e61d3ded2202f98962a411ca9f86f8246ecb9a6007 WatchSource:0}: Error finding container 1d2111b027db2f902f6ca2e61d3ded2202f98962a411ca9f86f8246ecb9a6007: Status 404 returned error can't find the container with id 1d2111b027db2f902f6ca2e61d3ded2202f98962a411ca9f86f8246ecb9a6007 Jul 14 16:31:12.740796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:12.740733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2" event={"ID":"e4d6d451-46b0-49e2-aa4f-9d86ba8e3850","Type":"ContainerStarted","Data":"1d2111b027db2f902f6ca2e61d3ded2202f98962a411ca9f86f8246ecb9a6007"} Jul 14 16:31:15.410869 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.410835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:31:15.411369 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.410900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:31:15.414180 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.414117 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 16:31:15.414856 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.414837 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 16:31:15.423866 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.423840 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0-original-pull-secret\") pod \"global-pull-secret-syncer-snds6\" (UID: \"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0\") " pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:31:15.423989 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.423850 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c736041f-ea1d-4f32-a0a1-4a6a708c9257-metrics-certs\") pod \"network-metrics-daemon-gnjbs\" (UID: \"c736041f-ea1d-4f32-a0a1-4a6a708c9257\") " pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:31:15.511784 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.511742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr6bb\" (UniqueName: \"kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb\") pod \"network-check-target-lqnfn\" (UID: \"5ea99c9e-73c9-4d79-815b-b0d0473ec652\") " pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:31:15.514990 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.514960 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 16:31:15.525671 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.525569 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 16:31:15.536065 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.536013 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr6bb\" (UniqueName: \"kubernetes.io/projected/5ea99c9e-73c9-4d79-815b-b0d0473ec652-kube-api-access-jr6bb\") pod \"network-check-target-lqnfn\" (UID: \"5ea99c9e-73c9-4d79-815b-b0d0473ec652\") " pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:31:15.593907 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.593874 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snds6" Jul 14 16:31:15.602016 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.601990 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cr5gm\"" Jul 14 16:31:15.606646 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.606624 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2hfc\"" Jul 14 16:31:15.609989 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.609967 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:31:15.614277 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.614259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnjbs" Jul 14 16:31:15.713009 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.712984 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tlwtx" Jul 14 16:31:15.753929 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.753898 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9c5d9b75-jv97z" event={"ID":"2f1acf56-4172-4f3b-b1af-54026bc1aa98","Type":"ContainerStarted","Data":"13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478"} Jul 14 16:31:15.755660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.755634 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2" event={"ID":"e4d6d451-46b0-49e2-aa4f-9d86ba8e3850","Type":"ContainerStarted","Data":"ebd0aaf99fc00af3cfe019b289b0acd2481bf1ca904fe29d453f8d1c5783db7b"} Jul 14 16:31:15.755821 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.755804 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2" Jul 14 16:31:15.761651 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.761629 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2" Jul 14 16:31:15.776343 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.776297 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b9c5d9b75-jv97z" podStartSLOduration=1.522470142 podStartE2EDuration="5.776282341s" totalImagesPullingTime="4.253812199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:15.775629605 +0000 UTC m=+66.637018889" watchObservedRunningTime="2026-07-14 16:31:15.776282341 +0000 UTC m=+66.637671624" Jul 14 16:31:15.793915 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.793864 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gpdx2" podStartSLOduration=2.04019263 podStartE2EDuration="4.793841703s" totalImagesPullingTime="2.753649073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:15.792317547 +0000 UTC m=+66.653706830" watchObservedRunningTime="2026-07-14 16:31:15.793841703 +0000 UTC m=+66.655230987" Jul 14 16:31:15.996228 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:15.996149 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gnjbs"] Jul 14 16:31:16.007822 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:16.007773 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc736041f_ea1d_4f32_a0a1_4a6a708c9257.slice/crio-a9a88116af5295dd73c00ce63873da19005762cd7b44a89916c7b0a8a13b7aea WatchSource:0}: Error finding container a9a88116af5295dd73c00ce63873da19005762cd7b44a89916c7b0a8a13b7aea: Status 404 returned error can't find the container with id a9a88116af5295dd73c00ce63873da19005762cd7b44a89916c7b0a8a13b7aea Jul 14 16:31:16.010231 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.010053 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lqnfn"] Jul 14 16:31:16.013308 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:16.013172 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea99c9e_73c9_4d79_815b_b0d0473ec652.slice/crio-e8998b618790d923a07b3278039e2857c3905a3cf62fa34ca33de7c87ca3bd20 WatchSource:0}: Error finding container e8998b618790d923a07b3278039e2857c3905a3cf62fa34ca33de7c87ca3bd20: Status 404 returned error can't find the container with id e8998b618790d923a07b3278039e2857c3905a3cf62fa34ca33de7c87ca3bd20 Jul 14 16:31:16.035116 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.032551 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-snds6"] Jul 14 16:31:16.038132 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:16.038106 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb23d2d_86d9_4f61_a9fc_f02ac1fa4da0.slice/crio-462ee304ebe3146b0d60cfce1ced9cf3c26095aab18fc68e636606019ab60517 WatchSource:0}: Error finding container 462ee304ebe3146b0d60cfce1ced9cf3c26095aab18fc68e636606019ab60517: Status 404 returned error can't find the container with id 462ee304ebe3146b0d60cfce1ced9cf3c26095aab18fc68e636606019ab60517 Jul 14 16:31:16.761244 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.761121 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" event={"ID":"2a93af83-7f49-4e78-98d5-d25a838926b2","Type":"ContainerStarted","Data":"8fa95b4441919546877c4122ce8e1acee71e586ebcab51a3457b7ebcc33a9c5c"} Jul 14 16:31:16.762362 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.762310 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lqnfn" event={"ID":"5ea99c9e-73c9-4d79-815b-b0d0473ec652","Type":"ContainerStarted","Data":"e8998b618790d923a07b3278039e2857c3905a3cf62fa34ca33de7c87ca3bd20"} Jul 14 16:31:16.763801 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.763765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-snds6" event={"ID":"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0","Type":"ContainerStarted","Data":"462ee304ebe3146b0d60cfce1ced9cf3c26095aab18fc68e636606019ab60517"} Jul 14 16:31:16.765357 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.765327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnjbs" event={"ID":"c736041f-ea1d-4f32-a0a1-4a6a708c9257","Type":"ContainerStarted","Data":"a9a88116af5295dd73c00ce63873da19005762cd7b44a89916c7b0a8a13b7aea"} Jul 14 16:31:16.785711 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.785581 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-4xn4t" podStartSLOduration=1.481418686 podStartE2EDuration="6.785558326s" totalImagesPullingTime="5.30413964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:16.782310849 +0000 UTC m=+67.643700132" watchObservedRunningTime="2026-07-14 16:31:16.785558326 +0000 UTC m=+67.646947610" Jul 14 16:31:16.786158 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.786115 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4flx2"] Jul 14 16:31:16.789530 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.789494 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:16.794154 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.793696 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 14 16:31:16.794154 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.793749 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 16:31:16.794154 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.793975 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 16:31:16.794154 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.794028 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 14 16:31:16.794427 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.794276 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 16:31:16.794733 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.794547 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mqrnr\"" Jul 14 16:31:16.801167 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.801141 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4flx2"] Jul 14 16:31:16.922640 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.922602 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13535f84-aaac-4092-840c-bef57c5f1b6e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:16.922825 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.922653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/13535f84-aaac-4092-840c-bef57c5f1b6e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:16.922825 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.922701 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13535f84-aaac-4092-840c-bef57c5f1b6e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:16.922825 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:16.922776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qdnn\" (UniqueName: \"kubernetes.io/projected/13535f84-aaac-4092-840c-bef57c5f1b6e-kube-api-access-7qdnn\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.024126 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.023791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/13535f84-aaac-4092-840c-bef57c5f1b6e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.024126 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.023845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13535f84-aaac-4092-840c-bef57c5f1b6e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.024126 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.023903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qdnn\" (UniqueName: \"kubernetes.io/projected/13535f84-aaac-4092-840c-bef57c5f1b6e-kube-api-access-7qdnn\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.024126 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:31:17.023970 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 14 16:31:17.024126 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.023981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13535f84-aaac-4092-840c-bef57c5f1b6e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.024126 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:31:17.024050 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13535f84-aaac-4092-840c-bef57c5f1b6e-prometheus-operator-tls podName:13535f84-aaac-4092-840c-bef57c5f1b6e nodeName:}" failed. No retries permitted until 2026-07-14 16:31:17.524026362 +0000 UTC m=+68.385415625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/13535f84-aaac-4092-840c-bef57c5f1b6e-prometheus-operator-tls") pod "prometheus-operator-64785b6675-4flx2" (UID: "13535f84-aaac-4092-840c-bef57c5f1b6e") : secret "prometheus-operator-tls" not found Jul 14 16:31:17.025483 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.025299 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13535f84-aaac-4092-840c-bef57c5f1b6e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.028056 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.027190 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13535f84-aaac-4092-840c-bef57c5f1b6e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.037578 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.037529 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qdnn\" (UniqueName: \"kubernetes.io/projected/13535f84-aaac-4092-840c-bef57c5f1b6e-kube-api-access-7qdnn\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.529085 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.529005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/13535f84-aaac-4092-840c-bef57c5f1b6e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.531788 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.531760 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/13535f84-aaac-4092-840c-bef57c5f1b6e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4flx2\" (UID: \"13535f84-aaac-4092-840c-bef57c5f1b6e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.709023 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.708937 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" Jul 14 16:31:17.776065 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.775977 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnjbs" event={"ID":"c736041f-ea1d-4f32-a0a1-4a6a708c9257","Type":"ContainerStarted","Data":"c1e72d2d657a8618a5284588f310da0549e1724a16360fae61c18306e5060f6e"} Jul 14 16:31:17.776065 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.776036 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnjbs" event={"ID":"c736041f-ea1d-4f32-a0a1-4a6a708c9257","Type":"ContainerStarted","Data":"0681dbba570567f02bc5f58f2a41f0f10b3412d3b72daf8633364ab409ea0fe8"} Jul 14 16:31:17.794992 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.794932 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gnjbs" podStartSLOduration=66.549330033 podStartE2EDuration="1m7.794911398s" totalImagesPullingTime="1.245581365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:17.793600152 +0000 UTC m=+68.654989436" watchObservedRunningTime="2026-07-14 16:31:17.794911398 +0000 UTC m=+68.656300686" Jul 14 16:31:17.865112 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:17.865079 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4flx2"] Jul 14 16:31:17.869485 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:17.869456 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13535f84_aaac_4092_840c_bef57c5f1b6e.slice/crio-7142062cac7763a3e49276030bb9e3f2b2b7cec2204c6ca2ba693e77e19d96f3 WatchSource:0}: Error finding container 7142062cac7763a3e49276030bb9e3f2b2b7cec2204c6ca2ba693e77e19d96f3: Status 404 returned error can't find the container with id 7142062cac7763a3e49276030bb9e3f2b2b7cec2204c6ca2ba693e77e19d96f3 Jul 14 16:31:18.552326 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.552265 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dd4d76f7-h5gvw"] Jul 14 16:31:18.556156 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.555887 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.569711 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.567648 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd4d76f7-h5gvw"] Jul 14 16:31:18.569711 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.569493 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 16:31:18.738874 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.738831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-serving-cert\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.739097 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.738883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-config\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.739097 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.738918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-oauth-config\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.739097 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.738947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-oauth-serving-cert\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.739097 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.738975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-trusted-ca-bundle\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.739097 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.739023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-service-ca\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.739097 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.739055 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzlv7\" (UniqueName: \"kubernetes.io/projected/3d31adf1-20e2-49e2-a254-d8dff2643b71-kube-api-access-wzlv7\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.783478 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.783437 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" event={"ID":"13535f84-aaac-4092-840c-bef57c5f1b6e","Type":"ContainerStarted","Data":"7142062cac7763a3e49276030bb9e3f2b2b7cec2204c6ca2ba693e77e19d96f3"} Jul 14 16:31:18.840127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.840004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-service-ca\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.840127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.840058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzlv7\" (UniqueName: \"kubernetes.io/projected/3d31adf1-20e2-49e2-a254-d8dff2643b71-kube-api-access-wzlv7\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.840127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.840116 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-serving-cert\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.840493 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.840146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-config\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.840493 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.840175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-oauth-config\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.840493 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.840202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-oauth-serving-cert\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.840493 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.840264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-trusted-ca-bundle\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.842770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.842733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-trusted-ca-bundle\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.848049 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.846557 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-config\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.848049 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.847132 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-service-ca\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.849595 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.849086 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-oauth-serving-cert\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.854013 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.853226 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-oauth-config\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.855349 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.854538 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-serving-cert\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.869353 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.869312 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzlv7\" (UniqueName: \"kubernetes.io/projected/3d31adf1-20e2-49e2-a254-d8dff2643b71-kube-api-access-wzlv7\") pod \"console-6dd4d76f7-h5gvw\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:18.873047 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:18.873009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:19.043403 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:19.043353 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd4d76f7-h5gvw"] Jul 14 16:31:20.071033 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:20.071003 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d31adf1_20e2_49e2_a254_d8dff2643b71.slice/crio-5c4e72ca59faa7c55727b0f3ce8fa513d1f5d33cb784832218dd1b9158255151 WatchSource:0}: Error finding container 5c4e72ca59faa7c55727b0f3ce8fa513d1f5d33cb784832218dd1b9158255151: Status 404 returned error can't find the container with id 5c4e72ca59faa7c55727b0f3ce8fa513d1f5d33cb784832218dd1b9158255151 Jul 14 16:31:20.093612 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:20.093589 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:31:20.544783 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:20.544743 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:20.544970 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:20.544811 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:20.550610 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:20.550585 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:20.794343 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:20.794291 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd4d76f7-h5gvw" event={"ID":"3d31adf1-20e2-49e2-a254-d8dff2643b71","Type":"ContainerStarted","Data":"5c4e72ca59faa7c55727b0f3ce8fa513d1f5d33cb784832218dd1b9158255151"} Jul 14 16:31:20.801044 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:20.800801 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:22.803533 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:22.803497 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lqnfn" event={"ID":"5ea99c9e-73c9-4d79-815b-b0d0473ec652","Type":"ContainerStarted","Data":"7a681a6a5fcecb325fb8f8867035b54f67be6422a97c4b1ecdcb7dac6a8ff878"} Jul 14 16:31:22.803996 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:22.803666 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:31:22.804937 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:22.804915 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-snds6" event={"ID":"dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0","Type":"ContainerStarted","Data":"4bbefcc66a03ec6d5b0b12af7ea7a488846c85c7ad4f29068db7ad7de8e5e9af"} Jul 14 16:31:22.806623 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:22.806603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" event={"ID":"13535f84-aaac-4092-840c-bef57c5f1b6e","Type":"ContainerStarted","Data":"8bb810541d5f18eab0b93ca9713e53caa1f614b1c034f2c0973d8f2dc8054490"} Jul 14 16:31:22.806692 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:22.806641 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" event={"ID":"13535f84-aaac-4092-840c-bef57c5f1b6e","Type":"ContainerStarted","Data":"c096826e843ffd571dae25e9926ad7075ea39a118b98cc4bfc6b46c5b44f8900"} Jul 14 16:31:22.808068 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:22.808048 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd4d76f7-h5gvw" event={"ID":"3d31adf1-20e2-49e2-a254-d8dff2643b71","Type":"ContainerStarted","Data":"730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323"} Jul 14 16:31:22.823567 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:22.823532 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lqnfn" podStartSLOduration=66.832034078 podStartE2EDuration="1m12.823520792s" totalImagesPullingTime="5.991486714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:22.822472074 +0000 UTC m=+73.683861368" watchObservedRunningTime="2026-07-14 16:31:22.823520792 +0000 UTC m=+73.684910076" Jul 14 16:31:22.842690 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:22.842650 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-4flx2" podStartSLOduration=2.707604622 podStartE2EDuration="6.842638269s" totalImagesPullingTime="4.135033647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:22.842310286 +0000 UTC m=+73.703699609" watchObservedRunningTime="2026-07-14 16:31:22.842638269 +0000 UTC m=+73.704027553" Jul 14 16:31:22.868377 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:22.868341 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dd4d76f7-h5gvw" podStartSLOduration=4.868329691 podStartE2EDuration="4.868329691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:22.867645226 +0000 UTC m=+73.729034510" watchObservedRunningTime="2026-07-14 16:31:22.868329691 +0000 UTC m=+73.729718974" Jul 14 16:31:22.885727 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:22.885685 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-snds6" podStartSLOduration=66.896708231 podStartE2EDuration="1m12.885668286s" totalImagesPullingTime="5.988960055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:22.884501573 +0000 UTC m=+73.745890856" watchObservedRunningTime="2026-07-14 16:31:22.885668286 +0000 UTC m=+73.747057572" Jul 14 16:31:25.383299 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.383265 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9m8jn"] Jul 14 16:31:25.388167 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.388147 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.393078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.393055 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 16:31:25.393188 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.393166 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 16:31:25.393241 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.393169 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hmsg7\"" Jul 14 16:31:25.393557 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.393543 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 16:31:25.394800 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.394773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-tls\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.394920 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.394851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-textfile\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.394987 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.394954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frw74\" (UniqueName: \"kubernetes.io/projected/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-kube-api-access-frw74\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.395041 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.394987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-wtmp\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.395041 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.395019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.395143 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.395059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-sys\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.395143 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.395117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-metrics-client-ca\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.395236 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.395159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-root\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.395289 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.395259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496285 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496488 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-tls\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496488 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496328 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-textfile\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496488 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frw74\" (UniqueName: \"kubernetes.io/projected/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-kube-api-access-frw74\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496488 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-wtmp\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496488 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496488 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496448 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-sys\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496488 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-metrics-client-ca\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496903 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-root\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496903 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496578 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-root\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496903 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496764 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-textfile\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.496903 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:31:25.496870 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 16:31:25.497087 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.496908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-sys\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.497087 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:31:25.496928 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-tls podName:2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca nodeName:}" failed. No retries permitted until 2026-07-14 16:31:25.996907723 +0000 UTC m=+76.858296999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-tls") pod "node-exporter-9m8jn" (UID: "2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca") : secret "node-exporter-tls" not found Jul 14 16:31:25.497197 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.497157 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-wtmp\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.501696 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.497148 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.501696 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.497916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-metrics-client-ca\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.502326 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.502302 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:25.514306 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:25.514285 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frw74\" (UniqueName: \"kubernetes.io/projected/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-kube-api-access-frw74\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:26.000824 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:26.000789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-tls\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:26.003330 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:26.003294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca-node-exporter-tls\") pod \"node-exporter-9m8jn\" (UID: \"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca\") " pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:26.298558 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:26.298476 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9m8jn" Jul 14 16:31:28.692453 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.692417 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl"] Jul 14 16:31:28.698245 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.698223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.710442 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.710411 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 14 16:31:28.710442 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.710418 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 14 16:31:28.710630 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.710493 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m5gsl\"" Jul 14 16:31:28.710691 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.710626 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-djtcih3sllncm\"" Jul 14 16:31:28.710767 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.710748 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 14 16:31:28.711224 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.711201 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 14 16:31:28.714864 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.714847 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 14 16:31:28.727164 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.727075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk92h\" (UniqueName: \"kubernetes.io/projected/60e579d0-b461-4ff3-be67-1a3b31aee7b0-kube-api-access-bk92h\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.727277 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.727209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.727277 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.727257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-tls\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.727404 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.727318 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-grpc-tls\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.727404 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.727352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60e579d0-b461-4ff3-be67-1a3b31aee7b0-metrics-client-ca\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.727524 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.727433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.727524 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.727438 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl"] Jul 14 16:31:28.727524 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.727514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.727666 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.727554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.828234 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.828203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.828425 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.828241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.828425 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.828290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk92h\" (UniqueName: \"kubernetes.io/projected/60e579d0-b461-4ff3-be67-1a3b31aee7b0-kube-api-access-bk92h\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.828425 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.828321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.828425 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.828353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-tls\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.828425 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.828399 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-grpc-tls\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.828759 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.828433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60e579d0-b461-4ff3-be67-1a3b31aee7b0-metrics-client-ca\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.828759 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.828475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.829369 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.829320 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60e579d0-b461-4ff3-be67-1a3b31aee7b0-metrics-client-ca\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.831300 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.831272 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.831788 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.831642 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-tls\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.831788 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.831718 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.832020 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.831854 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.832140 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.832098 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.832648 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.832628 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60e579d0-b461-4ff3-be67-1a3b31aee7b0-secret-grpc-tls\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.841113 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.841087 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk92h\" (UniqueName: \"kubernetes.io/projected/60e579d0-b461-4ff3-be67-1a3b31aee7b0-kube-api-access-bk92h\") pod \"thanos-querier-5cc797bb4c-c2wrl\" (UID: \"60e579d0-b461-4ff3-be67-1a3b31aee7b0\") " pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:28.873867 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.873840 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:28.873997 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.873899 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:28.879234 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:28.879215 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:29.009089 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.009005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:29.841516 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.841487 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:31:29.894695 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.894662 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d7df5546c-zcnk2"] Jul 14 16:31:29.956525 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.956495 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d7df5546c-zcnk2"] Jul 14 16:31:29.956681 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.956616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:29.969799 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.969776 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 16:31:29.969947 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.969922 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6fqdboqn9202r\"" Jul 14 16:31:29.970872 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.970850 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-br6tt\"" Jul 14 16:31:29.971265 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.971248 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 14 16:31:29.989171 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.989151 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 14 16:31:29.991956 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:29.991929 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 14 16:31:30.028250 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.028217 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b9c5d9b75-jv97z"] Jul 14 16:31:30.039398 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.039352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a11b187-18ac-4b04-bc9a-44dcc213c49a-secret-metrics-server-client-certs\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.039551 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.039437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz44c\" (UniqueName: \"kubernetes.io/projected/3a11b187-18ac-4b04-bc9a-44dcc213c49a-kube-api-access-sz44c\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.039551 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.039507 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a11b187-18ac-4b04-bc9a-44dcc213c49a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.039551 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.039542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a11b187-18ac-4b04-bc9a-44dcc213c49a-secret-metrics-server-tls\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.039725 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.039567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a11b187-18ac-4b04-bc9a-44dcc213c49a-client-ca-bundle\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.039725 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.039595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a11b187-18ac-4b04-bc9a-44dcc213c49a-audit-log\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.039725 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.039646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a11b187-18ac-4b04-bc9a-44dcc213c49a-metrics-server-audit-profiles\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.140679 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.140653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a11b187-18ac-4b04-bc9a-44dcc213c49a-secret-metrics-server-client-certs\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.140867 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.140699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz44c\" (UniqueName: \"kubernetes.io/projected/3a11b187-18ac-4b04-bc9a-44dcc213c49a-kube-api-access-sz44c\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.140867 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.140764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a11b187-18ac-4b04-bc9a-44dcc213c49a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.140990 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.140906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a11b187-18ac-4b04-bc9a-44dcc213c49a-secret-metrics-server-tls\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.141058 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.141026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a11b187-18ac-4b04-bc9a-44dcc213c49a-client-ca-bundle\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.141117 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.141077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a11b187-18ac-4b04-bc9a-44dcc213c49a-audit-log\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.141117 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.141104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a11b187-18ac-4b04-bc9a-44dcc213c49a-metrics-server-audit-profiles\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.141512 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.141488 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a11b187-18ac-4b04-bc9a-44dcc213c49a-audit-log\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.141613 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.141586 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a11b187-18ac-4b04-bc9a-44dcc213c49a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.142003 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.141978 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a11b187-18ac-4b04-bc9a-44dcc213c49a-metrics-server-audit-profiles\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.143599 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.143580 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a11b187-18ac-4b04-bc9a-44dcc213c49a-secret-metrics-server-client-certs\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.143717 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.143698 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a11b187-18ac-4b04-bc9a-44dcc213c49a-client-ca-bundle\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.143771 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.143702 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a11b187-18ac-4b04-bc9a-44dcc213c49a-secret-metrics-server-tls\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.159821 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.159800 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz44c\" (UniqueName: \"kubernetes.io/projected/3a11b187-18ac-4b04-bc9a-44dcc213c49a-kube-api-access-sz44c\") pod \"metrics-server-d7df5546c-zcnk2\" (UID: \"3a11b187-18ac-4b04-bc9a-44dcc213c49a\") " pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.269347 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.269306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:30.782720 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.782661 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84766bdf9f-c5dvt"] Jul 14 16:31:30.810089 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.810058 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.818052 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.817829 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 14 16:31:30.820464 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.820442 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mt2x9\"" Jul 14 16:31:30.827572 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.827552 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 14 16:31:30.827572 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.827556 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 14 16:31:30.827731 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.827620 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 14 16:31:30.833508 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.833488 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 14 16:31:30.838044 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.838023 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 14 16:31:30.847159 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.847124 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.847543 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.847160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-serving-certs-ca-bundle\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.847543 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.847187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-federate-client-tls\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.847543 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.847248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-telemeter-client-tls\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.847543 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.847277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-secret-telemeter-client\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.847543 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.847397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqrvm\" (UniqueName: \"kubernetes.io/projected/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-kube-api-access-sqrvm\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.847543 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.847466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.847543 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.847502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-metrics-client-ca\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.905882 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.905847 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84766bdf9f-c5dvt"] Jul 14 16:31:30.948534 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.948501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-secret-telemeter-client\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.948732 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.948567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrvm\" (UniqueName: \"kubernetes.io/projected/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-kube-api-access-sqrvm\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.948804 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.948747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.948804 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.948791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-metrics-client-ca\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.948920 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.948893 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.948973 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.948939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-serving-certs-ca-bundle\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.948973 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.948963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-federate-client-tls\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.949243 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.949139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-telemeter-client-tls\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.949638 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.949613 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-metrics-client-ca\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.949986 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.949939 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-serving-certs-ca-bundle\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.950431 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.950407 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.951860 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.951828 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-telemeter-client-tls\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.952246 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.952218 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.952378 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.952355 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-federate-client-tls\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.952532 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.952514 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-secret-telemeter-client\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:30.963378 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:30.963353 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqrvm\" (UniqueName: \"kubernetes.io/projected/ebc65df5-777f-46f8-9ff8-dd9c0a7155ba-kube-api-access-sqrvm\") pod \"telemeter-client-84766bdf9f-c5dvt\" (UID: \"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba\") " pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:31.120764 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.120603 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" Jul 14 16:31:31.214203 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.214168 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6596c8d5f5-7vgd2"] Jul 14 16:31:31.240244 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.240220 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.244372 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.244346 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6596c8d5f5-7vgd2"] Jul 14 16:31:31.352045 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.352005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-oauth-config\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.352045 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.352042 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-config\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.352289 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.352065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-trusted-ca-bundle\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.352289 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.352144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-serving-cert\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.352289 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.352194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-service-ca\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.352289 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.352227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4zg6\" (UniqueName: \"kubernetes.io/projected/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-kube-api-access-g4zg6\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.352464 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.352348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-oauth-serving-cert\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.453710 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.453674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-oauth-serving-cert\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.453710 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.453715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-oauth-config\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.453955 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.453734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-config\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.453955 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.453760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-trusted-ca-bundle\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.453955 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.453805 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-serving-cert\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.453955 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.453866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-service-ca\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.453955 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.453902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4zg6\" (UniqueName: \"kubernetes.io/projected/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-kube-api-access-g4zg6\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.454979 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.454463 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-oauth-serving-cert\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.454979 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.454934 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-service-ca\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.454979 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.454974 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-config\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.455196 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.455053 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-trusted-ca-bundle\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.456772 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.456754 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-serving-cert\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.456883 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.456827 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-oauth-config\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.464886 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.464858 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4zg6\" (UniqueName: \"kubernetes.io/projected/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-kube-api-access-g4zg6\") pod \"console-6596c8d5f5-7vgd2\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:31.553512 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:31.553478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:32.035600 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:32.035561 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2412f70d_ac6c_4e08_82c2_1c5bffb5e9ca.slice/crio-7bf1bdb95bb9c2425ef0be602ef120624dc7eecdc94da90f43b287a9bae71642 WatchSource:0}: Error finding container 7bf1bdb95bb9c2425ef0be602ef120624dc7eecdc94da90f43b287a9bae71642: Status 404 returned error can't find the container with id 7bf1bdb95bb9c2425ef0be602ef120624dc7eecdc94da90f43b287a9bae71642 Jul 14 16:31:32.232669 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.232646 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl"] Jul 14 16:31:32.346725 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:32.346651 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e579d0_b461_4ff3_be67_1a3b31aee7b0.slice/crio-ac5820bc4c1f5d1b0ba7eb1d2633486e52a21b33012e12a295e9c409cba4d5b4 WatchSource:0}: Error finding container ac5820bc4c1f5d1b0ba7eb1d2633486e52a21b33012e12a295e9c409cba4d5b4: Status 404 returned error can't find the container with id ac5820bc4c1f5d1b0ba7eb1d2633486e52a21b33012e12a295e9c409cba4d5b4 Jul 14 16:31:32.440702 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.440679 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6596c8d5f5-7vgd2"] Jul 14 16:31:32.442735 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:32.442713 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c1f566_0512_4b79_9f7c_3e7ba4167f53.slice/crio-540cc0f46f03330af8a6fdfd57a630c5535b5adfd5da911527429ef18b5ac87c WatchSource:0}: Error finding container 540cc0f46f03330af8a6fdfd57a630c5535b5adfd5da911527429ef18b5ac87c: Status 404 returned error can't find the container with id 540cc0f46f03330af8a6fdfd57a630c5535b5adfd5da911527429ef18b5ac87c Jul 14 16:31:32.459287 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.459265 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d7df5546c-zcnk2"] Jul 14 16:31:32.461842 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:32.461819 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a11b187_18ac_4b04_bc9a_44dcc213c49a.slice/crio-12f33b9bc9f50ccbcb264f2a309ccbba59f385a8b397bfbed1ef9781da60ed05 WatchSource:0}: Error finding container 12f33b9bc9f50ccbcb264f2a309ccbba59f385a8b397bfbed1ef9781da60ed05: Status 404 returned error can't find the container with id 12f33b9bc9f50ccbcb264f2a309ccbba59f385a8b397bfbed1ef9781da60ed05 Jul 14 16:31:32.466008 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.465986 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84766bdf9f-c5dvt"] Jul 14 16:31:32.470975 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:32.470955 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc65df5_777f_46f8_9ff8_dd9c0a7155ba.slice/crio-3a3db9a2bc4ef632e6aa3b7187ba914ba4cf54a7fe2af8f27adc0b28668074a0 WatchSource:0}: Error finding container 3a3db9a2bc4ef632e6aa3b7187ba914ba4cf54a7fe2af8f27adc0b28668074a0: Status 404 returned error can't find the container with id 3a3db9a2bc4ef632e6aa3b7187ba914ba4cf54a7fe2af8f27adc0b28668074a0 Jul 14 16:31:32.746418 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.746370 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f88dd9f97-kdkd6" Jul 14 16:31:32.852348 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.852309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-jsf6w" event={"ID":"84db6128-6bbe-45af-a180-f48a5f6d9dce","Type":"ContainerStarted","Data":"67018c5e7e22f1c522598df0e78b9f6b0546401a36af59945c8b13ed91d519a5"} Jul 14 16:31:32.852600 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.852582 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-jsf6w" Jul 14 16:31:32.853967 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.853934 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" event={"ID":"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba","Type":"ContainerStarted","Data":"3a3db9a2bc4ef632e6aa3b7187ba914ba4cf54a7fe2af8f27adc0b28668074a0"} Jul 14 16:31:32.855489 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.855466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9m8jn" event={"ID":"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca","Type":"ContainerStarted","Data":"7bf1bdb95bb9c2425ef0be602ef120624dc7eecdc94da90f43b287a9bae71642"} Jul 14 16:31:32.856795 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.856768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" event={"ID":"3a11b187-18ac-4b04-bc9a-44dcc213c49a","Type":"ContainerStarted","Data":"12f33b9bc9f50ccbcb264f2a309ccbba59f385a8b397bfbed1ef9781da60ed05"} Jul 14 16:31:32.858659 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.858633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6596c8d5f5-7vgd2" event={"ID":"a5c1f566-0512-4b79-9f7c-3e7ba4167f53","Type":"ContainerStarted","Data":"bf1dd5494c9810c7c659d7e49edef0000faf411efd10a86b6c2a9ed6bdc34d84"} Jul 14 16:31:32.858747 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.858674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6596c8d5f5-7vgd2" event={"ID":"a5c1f566-0512-4b79-9f7c-3e7ba4167f53","Type":"ContainerStarted","Data":"540cc0f46f03330af8a6fdfd57a630c5535b5adfd5da911527429ef18b5ac87c"} Jul 14 16:31:32.860116 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.860093 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" event={"ID":"60e579d0-b461-4ff3-be67-1a3b31aee7b0","Type":"ContainerStarted","Data":"ac5820bc4c1f5d1b0ba7eb1d2633486e52a21b33012e12a295e9c409cba4d5b4"} Jul 14 16:31:32.861895 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.861874 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-jsf6w" Jul 14 16:31:32.893896 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.893841 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-jsf6w" podStartSLOduration=1.047763222 podStartE2EDuration="22.89382398s" totalImagesPullingTime="21.846060758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:32.892327043 +0000 UTC m=+83.753716361" watchObservedRunningTime="2026-07-14 16:31:32.89382398 +0000 UTC m=+83.755213265" Jul 14 16:31:32.928017 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:32.927955 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6596c8d5f5-7vgd2" podStartSLOduration=1.927934092 podStartE2EDuration="1.927934092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:32.924431307 +0000 UTC m=+83.785820590" watchObservedRunningTime="2026-07-14 16:31:32.927934092 +0000 UTC m=+83.789323384" Jul 14 16:31:35.109117 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:35.109047 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" podUID="f1745bf3-fb14-4913-a3ad-391a164a11a9" containerName="registry" containerID="cri-o://c8b82715c6f3179b3a0d8d5794e7253e9213c44a807b63fe3b5431eb9925aa3b" gracePeriod=30 Jul 14 16:31:35.880869 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:35.880833 2564 generic.go:356] "Generic (PLEG): container finished" podID="f1745bf3-fb14-4913-a3ad-391a164a11a9" containerID="c8b82715c6f3179b3a0d8d5794e7253e9213c44a807b63fe3b5431eb9925aa3b" exitCode=0 Jul 14 16:31:35.881078 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:35.880886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" event={"ID":"f1745bf3-fb14-4913-a3ad-391a164a11a9","Type":"ContainerDied","Data":"c8b82715c6f3179b3a0d8d5794e7253e9213c44a807b63fe3b5431eb9925aa3b"} Jul 14 16:31:36.397123 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.397100 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:31:36.505796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.505011 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-installation-pull-secrets\") pod \"f1745bf3-fb14-4913-a3ad-391a164a11a9\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " Jul 14 16:31:36.505796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.505073 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-bound-sa-token\") pod \"f1745bf3-fb14-4913-a3ad-391a164a11a9\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " Jul 14 16:31:36.505796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.505131 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-certificates\") pod \"f1745bf3-fb14-4913-a3ad-391a164a11a9\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " Jul 14 16:31:36.505796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.505159 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlg9b\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-kube-api-access-dlg9b\") pod \"f1745bf3-fb14-4913-a3ad-391a164a11a9\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " Jul 14 16:31:36.505796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.505211 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-trusted-ca\") pod \"f1745bf3-fb14-4913-a3ad-391a164a11a9\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " Jul 14 16:31:36.505796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.505242 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1745bf3-fb14-4913-a3ad-391a164a11a9-ca-trust-extracted\") pod \"f1745bf3-fb14-4913-a3ad-391a164a11a9\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " Jul 14 16:31:36.505796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.505291 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-image-registry-private-configuration\") pod \"f1745bf3-fb14-4913-a3ad-391a164a11a9\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " Jul 14 16:31:36.505796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.505410 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls\") pod \"f1745bf3-fb14-4913-a3ad-391a164a11a9\" (UID: \"f1745bf3-fb14-4913-a3ad-391a164a11a9\") " Jul 14 16:31:36.505796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.505640 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f1745bf3-fb14-4913-a3ad-391a164a11a9" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:31:36.505796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.505706 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f1745bf3-fb14-4913-a3ad-391a164a11a9" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:31:36.512504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.512431 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f1745bf3-fb14-4913-a3ad-391a164a11a9" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:31:36.513794 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.513760 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-kube-api-access-dlg9b" (OuterVolumeSpecName: "kube-api-access-dlg9b") pod "f1745bf3-fb14-4913-a3ad-391a164a11a9" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9"). InnerVolumeSpecName "kube-api-access-dlg9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:31:36.519127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.519100 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1745bf3-fb14-4913-a3ad-391a164a11a9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f1745bf3-fb14-4913-a3ad-391a164a11a9" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:31:36.519613 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.519586 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f1745bf3-fb14-4913-a3ad-391a164a11a9" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:31:36.520057 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.520033 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f1745bf3-fb14-4913-a3ad-391a164a11a9" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:31:36.520646 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.520611 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f1745bf3-fb14-4913-a3ad-391a164a11a9" (UID: "f1745bf3-fb14-4913-a3ad-391a164a11a9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:31:36.606346 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.606320 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-tls\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:36.606479 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.606349 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-installation-pull-secrets\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:36.606479 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.606363 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-bound-sa-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:36.606479 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.606377 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-registry-certificates\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:36.606479 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.606405 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlg9b\" (UniqueName: \"kubernetes.io/projected/f1745bf3-fb14-4913-a3ad-391a164a11a9-kube-api-access-dlg9b\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:36.606479 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.606418 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1745bf3-fb14-4913-a3ad-391a164a11a9-trusted-ca\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:36.606479 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.606429 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1745bf3-fb14-4913-a3ad-391a164a11a9-ca-trust-extracted\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:36.606479 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.606442 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1745bf3-fb14-4913-a3ad-391a164a11a9-image-registry-private-configuration\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:36.889207 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.887833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" event={"ID":"f1745bf3-fb14-4913-a3ad-391a164a11a9","Type":"ContainerDied","Data":"6906af25f76cf8d34597d795ed1b336f899bfab03f8dc020258083f252e64927"} Jul 14 16:31:36.889207 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.887912 2564 scope.go:117] "RemoveContainer" containerID="c8b82715c6f3179b3a0d8d5794e7253e9213c44a807b63fe3b5431eb9925aa3b" Jul 14 16:31:36.889207 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.888071 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c559779dc-9d5hb" Jul 14 16:31:36.902832 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.901848 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" event={"ID":"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba","Type":"ContainerStarted","Data":"7bd81657d9bef8c9abe5e1f41e923cce3091988a689f9d5f3cb50728af970478"} Jul 14 16:31:36.906740 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.905953 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" event={"ID":"3a11b187-18ac-4b04-bc9a-44dcc213c49a","Type":"ContainerStarted","Data":"b545123f598f57850283bfdd69a68d349b68dc9f3e25147edb6b980b9b020251"} Jul 14 16:31:36.912492 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.912343 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" event={"ID":"60e579d0-b461-4ff3-be67-1a3b31aee7b0","Type":"ContainerStarted","Data":"f532c493fcb7e44074298ea6954f70a2c73489595516f538ba360c4b981d2519"} Jul 14 16:31:36.912492 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.912437 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" event={"ID":"60e579d0-b461-4ff3-be67-1a3b31aee7b0","Type":"ContainerStarted","Data":"ef23ec80e6527316b14d69f9a2638a713f89e9310ed1f0d098f3a68aca618ef6"} Jul 14 16:31:36.990397 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:36.988595 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" podStartSLOduration=4.206369546 podStartE2EDuration="7.988574102s" totalImagesPullingTime="3.782204556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:36.987582134 +0000 UTC m=+87.848971419" watchObservedRunningTime="2026-07-14 16:31:36.988574102 +0000 UTC m=+87.849963390" Jul 14 16:31:37.108181 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:37.108060 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c559779dc-9d5hb"] Jul 14 16:31:37.142328 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:37.142031 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c559779dc-9d5hb"] Jul 14 16:31:37.919998 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:37.919954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" event={"ID":"60e579d0-b461-4ff3-be67-1a3b31aee7b0","Type":"ContainerStarted","Data":"78b79d1f0fbe49ab7edb5312977cc3414cbb6702c315c25bf83dd959ffb4d1eb"} Jul 14 16:31:38.489291 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:38.489253 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1745bf3-fb14-4913-a3ad-391a164a11a9" path="/var/lib/kubelet/pods/f1745bf3-fb14-4913-a3ad-391a164a11a9/volumes" Jul 14 16:31:38.928954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:38.928872 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" event={"ID":"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba","Type":"ContainerStarted","Data":"80f08954750f6443316645016edc66dee54149322b7a0e857b3dd162380cb7bd"} Jul 14 16:31:38.928954 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:38.928943 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" event={"ID":"ebc65df5-777f-46f8-9ff8-dd9c0a7155ba","Type":"ContainerStarted","Data":"57cfe63ffcf9057a6e0ba395c76cf5e1395de9ca8c99d3125f934b7fcee810fd"} Jul 14 16:31:38.930617 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:38.930590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9m8jn" event={"ID":"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca","Type":"ContainerStarted","Data":"e16d4ed0b3be799cb57eb12b702ebcbbab2c38531a2c2d8bc43b10d6b00130ff"} Jul 14 16:31:38.977786 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:38.977736 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84766bdf9f-c5dvt" podStartSLOduration=3.186351563 podStartE2EDuration="8.977718682s" totalImagesPullingTime="5.791367119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:38.977060185 +0000 UTC m=+89.838449471" watchObservedRunningTime="2026-07-14 16:31:38.977718682 +0000 UTC m=+89.839107964" Jul 14 16:31:39.791474 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.791440 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6596c8d5f5-7vgd2"] Jul 14 16:31:39.864144 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.864110 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-868d77987d-rkqxn"] Jul 14 16:31:39.864558 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.864540 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1745bf3-fb14-4913-a3ad-391a164a11a9" containerName="registry" Jul 14 16:31:39.864558 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.864559 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1745bf3-fb14-4913-a3ad-391a164a11a9" containerName="registry" Jul 14 16:31:39.864728 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.864630 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1745bf3-fb14-4913-a3ad-391a164a11a9" containerName="registry" Jul 14 16:31:39.886352 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.886316 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:39.892104 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.892083 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868d77987d-rkqxn"] Jul 14 16:31:39.939059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.938179 2564 generic.go:356] "Generic (PLEG): container finished" podID="2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca" containerID="e16d4ed0b3be799cb57eb12b702ebcbbab2c38531a2c2d8bc43b10d6b00130ff" exitCode=0 Jul 14 16:31:39.939059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.938327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9m8jn" event={"ID":"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca","Type":"ContainerDied","Data":"e16d4ed0b3be799cb57eb12b702ebcbbab2c38531a2c2d8bc43b10d6b00130ff"} Jul 14 16:31:39.939059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.938518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-trusted-ca-bundle\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:39.939059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.938568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-config\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:39.939059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.938626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-service-ca\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:39.939059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.938660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-oauth-serving-cert\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:39.939059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.938691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q88dr\" (UniqueName: \"kubernetes.io/projected/6000834a-539f-4c9f-8be9-56af4cf9cb05-kube-api-access-q88dr\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:39.939059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.938733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-serving-cert\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:39.939059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.938768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-oauth-config\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:39.944095 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.943927 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" event={"ID":"60e579d0-b461-4ff3-be67-1a3b31aee7b0","Type":"ContainerStarted","Data":"c77d08edafa1cd0cc5e66f566e3840c4651aa7e154d05c2eee4a2aa2944a1640"} Jul 14 16:31:39.944095 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.944013 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" event={"ID":"60e579d0-b461-4ff3-be67-1a3b31aee7b0","Type":"ContainerStarted","Data":"66ca05a0be7f108de5b1d050e86c07e6cd69c71deaab1aae9eedce43e63b1fcb"} Jul 14 16:31:39.944095 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.944059 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" event={"ID":"60e579d0-b461-4ff3-be67-1a3b31aee7b0","Type":"ContainerStarted","Data":"ee1a9ab0af036d646aabc2cd1b93b02292b5f8238f5e39a2861569f9366a3df3"} Jul 14 16:31:39.944452 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:39.944430 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:40.039677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.039641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-trusted-ca-bundle\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.039819 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.039725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-config\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.039930 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.039911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-service-ca\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.039992 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.039959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-oauth-serving-cert\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.040088 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.040006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88dr\" (UniqueName: \"kubernetes.io/projected/6000834a-539f-4c9f-8be9-56af4cf9cb05-kube-api-access-q88dr\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.040146 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.040103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-serving-cert\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.040233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.040214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-oauth-config\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.041045 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.041020 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-oauth-serving-cert\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.042021 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.041968 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-trusted-ca-bundle\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.042912 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.042881 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-config\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.044043 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.044006 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-service-ca\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.045031 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.045004 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-serving-cert\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.045630 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.045606 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-oauth-config\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.059828 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.059800 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q88dr\" (UniqueName: \"kubernetes.io/projected/6000834a-539f-4c9f-8be9-56af4cf9cb05-kube-api-access-q88dr\") pod \"console-868d77987d-rkqxn\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.199009 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.198977 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:40.411353 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.411298 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" podStartSLOduration=6.135384386 podStartE2EDuration="12.411277094s" totalImagesPullingTime="6.275892708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:40.042458801 +0000 UTC m=+90.903848088" watchObservedRunningTime="2026-07-14 16:31:40.411277094 +0000 UTC m=+91.272666424" Jul 14 16:31:40.412093 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.412048 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868d77987d-rkqxn"] Jul 14 16:31:40.416812 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:31:40.416783 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6000834a_539f_4c9f_8be9_56af4cf9cb05.slice/crio-4a175d56d838f615065a726635997288470d8db84bb983e8350e7698fa78f53e WatchSource:0}: Error finding container 4a175d56d838f615065a726635997288470d8db84bb983e8350e7698fa78f53e: Status 404 returned error can't find the container with id 4a175d56d838f615065a726635997288470d8db84bb983e8350e7698fa78f53e Jul 14 16:31:40.951410 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.951339 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868d77987d-rkqxn" event={"ID":"6000834a-539f-4c9f-8be9-56af4cf9cb05","Type":"ContainerStarted","Data":"968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07"} Jul 14 16:31:40.951925 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.951423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868d77987d-rkqxn" event={"ID":"6000834a-539f-4c9f-8be9-56af4cf9cb05","Type":"ContainerStarted","Data":"4a175d56d838f615065a726635997288470d8db84bb983e8350e7698fa78f53e"} Jul 14 16:31:40.953984 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.953952 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9m8jn" event={"ID":"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca","Type":"ContainerStarted","Data":"e9aeaee91b2bdebd692de5863815f97f54b3edd7fed3fe1f2984555460729873"} Jul 14 16:31:40.954106 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.954011 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9m8jn" event={"ID":"2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca","Type":"ContainerStarted","Data":"d6e5791a2e8c137755506d9bec3dc5c8f230a8e99c29fb8d54e72802390ca95f"} Jul 14 16:31:40.981740 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:40.981686 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-868d77987d-rkqxn" podStartSLOduration=1.981671153 podStartE2EDuration="1.981671153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:40.980477626 +0000 UTC m=+91.841866910" watchObservedRunningTime="2026-07-14 16:31:40.981671153 +0000 UTC m=+91.843060435" Jul 14 16:31:41.019579 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:41.014459 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9m8jn" podStartSLOduration=9.337505397 podStartE2EDuration="16.014440374s" totalImagesPullingTime="6.569500332s" totalInitContainerRuntime="107.434645ms" isStatefulPod=true podCreationTimestamp="2026-07-14 16:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:41.012901591 +0000 UTC m=+91.874290874" watchObservedRunningTime="2026-07-14 16:31:41.014440374 +0000 UTC m=+91.875829657" Jul 14 16:31:41.554333 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:41.554301 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:31:45.960262 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:45.960234 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5cc797bb4c-c2wrl" Jul 14 16:31:50.200096 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:50.200057 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:50.200649 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:50.200190 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:50.204990 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:50.204970 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:50.269690 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:50.269665 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:50.269836 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:50.269711 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:31:51.000666 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:51.000636 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:31:51.070160 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:51.070125 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd4d76f7-h5gvw"] Jul 14 16:31:53.815413 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:53.815372 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lqnfn" Jul 14 16:31:55.055982 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.055906 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b9c5d9b75-jv97z" podUID="2f1acf56-4172-4f3b-b1af-54026bc1aa98" containerName="console" containerID="cri-o://13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478" gracePeriod=15 Jul 14 16:31:55.335659 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.335631 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:55.476412 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.476364 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk5sw\" (UniqueName: \"kubernetes.io/projected/2f1acf56-4172-4f3b-b1af-54026bc1aa98-kube-api-access-kk5sw\") pod \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " Jul 14 16:31:55.476412 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.476419 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-service-ca\") pod \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " Jul 14 16:31:55.476649 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.476443 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-oauth-serving-cert\") pod \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " Jul 14 16:31:55.476649 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.476470 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-serving-cert\") pod \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " Jul 14 16:31:55.476649 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.476583 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-oauth-config\") pod \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " Jul 14 16:31:55.476649 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.476645 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-config\") pod \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\" (UID: \"2f1acf56-4172-4f3b-b1af-54026bc1aa98\") " Jul 14 16:31:55.476852 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.476826 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f1acf56-4172-4f3b-b1af-54026bc1aa98" (UID: "2f1acf56-4172-4f3b-b1af-54026bc1aa98"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:31:55.476976 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.476836 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f1acf56-4172-4f3b-b1af-54026bc1aa98" (UID: "2f1acf56-4172-4f3b-b1af-54026bc1aa98"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:31:55.477128 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.476988 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-config" (OuterVolumeSpecName: "console-config") pod "2f1acf56-4172-4f3b-b1af-54026bc1aa98" (UID: "2f1acf56-4172-4f3b-b1af-54026bc1aa98"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:31:55.478818 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.478788 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f1acf56-4172-4f3b-b1af-54026bc1aa98" (UID: "2f1acf56-4172-4f3b-b1af-54026bc1aa98"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:31:55.478818 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.478803 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f1acf56-4172-4f3b-b1af-54026bc1aa98-kube-api-access-kk5sw" (OuterVolumeSpecName: "kube-api-access-kk5sw") pod "2f1acf56-4172-4f3b-b1af-54026bc1aa98" (UID: "2f1acf56-4172-4f3b-b1af-54026bc1aa98"). InnerVolumeSpecName "kube-api-access-kk5sw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:31:55.478940 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.478856 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f1acf56-4172-4f3b-b1af-54026bc1aa98" (UID: "2f1acf56-4172-4f3b-b1af-54026bc1aa98"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:31:55.578124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.578057 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk5sw\" (UniqueName: \"kubernetes.io/projected/2f1acf56-4172-4f3b-b1af-54026bc1aa98-kube-api-access-kk5sw\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:55.578124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.578082 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-service-ca\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:55.578124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.578092 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-oauth-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:55.578124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.578100 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:55.578124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.578109 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-oauth-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:55.578124 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:55.578119 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1acf56-4172-4f3b-b1af-54026bc1aa98-console-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:31:56.016788 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:56.016745 2564 generic.go:356] "Generic (PLEG): container finished" podID="2f1acf56-4172-4f3b-b1af-54026bc1aa98" containerID="13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478" exitCode=0 Jul 14 16:31:56.016971 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:56.016792 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9c5d9b75-jv97z" Jul 14 16:31:56.016971 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:56.016839 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9c5d9b75-jv97z" event={"ID":"2f1acf56-4172-4f3b-b1af-54026bc1aa98","Type":"ContainerDied","Data":"13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478"} Jul 14 16:31:56.016971 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:56.016894 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9c5d9b75-jv97z" event={"ID":"2f1acf56-4172-4f3b-b1af-54026bc1aa98","Type":"ContainerDied","Data":"491172df171ca8e85852c278a20ca9cec6e055da3a94e452b71f7fe74210df08"} Jul 14 16:31:56.016971 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:56.016920 2564 scope.go:117] "RemoveContainer" containerID="13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478" Jul 14 16:31:56.025697 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:56.025681 2564 scope.go:117] "RemoveContainer" containerID="13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478" Jul 14 16:31:56.025959 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:31:56.025939 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478\": container with ID starting with 13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478 not found: ID does not exist" containerID="13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478" Jul 14 16:31:56.026009 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:56.025969 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478"} err="failed to get container status \"13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478\": rpc error: code = NotFound desc = could not find container \"13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478\": container with ID starting with 13d828cc4d136f6f155e56618485b55d1e8edcbce720f460f8a22e8a2321b478 not found: ID does not exist" Jul 14 16:31:56.038998 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:56.038967 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b9c5d9b75-jv97z"] Jul 14 16:31:56.044314 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:56.044291 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b9c5d9b75-jv97z"] Jul 14 16:31:56.487247 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:31:56.487218 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f1acf56-4172-4f3b-b1af-54026bc1aa98" path="/var/lib/kubelet/pods/2f1acf56-4172-4f3b-b1af-54026bc1aa98/volumes" Jul 14 16:32:04.819103 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:04.819034 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6596c8d5f5-7vgd2" podUID="a5c1f566-0512-4b79-9f7c-3e7ba4167f53" containerName="console" containerID="cri-o://bf1dd5494c9810c7c659d7e49edef0000faf411efd10a86b6c2a9ed6bdc34d84" gracePeriod=15 Jul 14 16:32:05.053145 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.053122 2564 generic.go:356] "Generic (PLEG): container finished" podID="a5c1f566-0512-4b79-9f7c-3e7ba4167f53" containerID="bf1dd5494c9810c7c659d7e49edef0000faf411efd10a86b6c2a9ed6bdc34d84" exitCode=0 Jul 14 16:32:05.053227 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.053200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6596c8d5f5-7vgd2" event={"ID":"a5c1f566-0512-4b79-9f7c-3e7ba4167f53","Type":"ContainerDied","Data":"bf1dd5494c9810c7c659d7e49edef0000faf411efd10a86b6c2a9ed6bdc34d84"} Jul 14 16:32:05.053278 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.053265 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6596c8d5f5-7vgd2" event={"ID":"a5c1f566-0512-4b79-9f7c-3e7ba4167f53","Type":"ContainerDied","Data":"540cc0f46f03330af8a6fdfd57a630c5535b5adfd5da911527429ef18b5ac87c"} Jul 14 16:32:05.053311 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.053289 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="540cc0f46f03330af8a6fdfd57a630c5535b5adfd5da911527429ef18b5ac87c" Jul 14 16:32:05.080881 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.080825 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:32:05.256906 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.256874 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-serving-cert\") pod \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " Jul 14 16:32:05.257127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.256934 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-service-ca\") pod \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " Jul 14 16:32:05.257127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.256955 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4zg6\" (UniqueName: \"kubernetes.io/projected/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-kube-api-access-g4zg6\") pod \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " Jul 14 16:32:05.257127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.257006 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-oauth-serving-cert\") pod \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " Jul 14 16:32:05.257127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.257029 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-config\") pod \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " Jul 14 16:32:05.257127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.257052 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-trusted-ca-bundle\") pod \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " Jul 14 16:32:05.257418 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.257197 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-oauth-config\") pod \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\" (UID: \"a5c1f566-0512-4b79-9f7c-3e7ba4167f53\") " Jul 14 16:32:05.257483 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.257445 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a5c1f566-0512-4b79-9f7c-3e7ba4167f53" (UID: "a5c1f566-0512-4b79-9f7c-3e7ba4167f53"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:32:05.257483 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.257459 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-service-ca" (OuterVolumeSpecName: "service-ca") pod "a5c1f566-0512-4b79-9f7c-3e7ba4167f53" (UID: "a5c1f566-0512-4b79-9f7c-3e7ba4167f53"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:32:05.257571 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.257480 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-config" (OuterVolumeSpecName: "console-config") pod "a5c1f566-0512-4b79-9f7c-3e7ba4167f53" (UID: "a5c1f566-0512-4b79-9f7c-3e7ba4167f53"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:32:05.257571 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.257529 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a5c1f566-0512-4b79-9f7c-3e7ba4167f53" (UID: "a5c1f566-0512-4b79-9f7c-3e7ba4167f53"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:32:05.257571 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.257551 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-oauth-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:05.257666 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.257571 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-service-ca\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:05.259045 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.259017 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a5c1f566-0512-4b79-9f7c-3e7ba4167f53" (UID: "a5c1f566-0512-4b79-9f7c-3e7ba4167f53"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:32:05.259202 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.259177 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-kube-api-access-g4zg6" (OuterVolumeSpecName: "kube-api-access-g4zg6") pod "a5c1f566-0512-4b79-9f7c-3e7ba4167f53" (UID: "a5c1f566-0512-4b79-9f7c-3e7ba4167f53"). InnerVolumeSpecName "kube-api-access-g4zg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:32:05.259359 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.259338 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a5c1f566-0512-4b79-9f7c-3e7ba4167f53" (UID: "a5c1f566-0512-4b79-9f7c-3e7ba4167f53"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:32:05.358942 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.358877 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:05.358942 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.358903 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-trusted-ca-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:05.358942 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.358914 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-oauth-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:05.358942 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.358923 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-console-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:05.358942 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:05.358932 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4zg6\" (UniqueName: \"kubernetes.io/projected/a5c1f566-0512-4b79-9f7c-3e7ba4167f53-kube-api-access-g4zg6\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:06.057574 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:06.057545 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6596c8d5f5-7vgd2" Jul 14 16:32:06.086965 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:06.086934 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6596c8d5f5-7vgd2"] Jul 14 16:32:06.091108 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:06.091085 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6596c8d5f5-7vgd2"] Jul 14 16:32:06.487056 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:06.487025 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5c1f566-0512-4b79-9f7c-3e7ba4167f53" path="/var/lib/kubelet/pods/a5c1f566-0512-4b79-9f7c-3e7ba4167f53/volumes" Jul 14 16:32:10.275007 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:10.274980 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:32:10.278731 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:10.278708 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d7df5546c-zcnk2" Jul 14 16:32:16.093316 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.093260 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dd4d76f7-h5gvw" podUID="3d31adf1-20e2-49e2-a254-d8dff2643b71" containerName="console" containerID="cri-o://730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323" gracePeriod=15 Jul 14 16:32:16.371840 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.371778 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:32:16.441997 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.441964 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzlv7\" (UniqueName: \"kubernetes.io/projected/3d31adf1-20e2-49e2-a254-d8dff2643b71-kube-api-access-wzlv7\") pod \"3d31adf1-20e2-49e2-a254-d8dff2643b71\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " Jul 14 16:32:16.441997 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.442001 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-oauth-serving-cert\") pod \"3d31adf1-20e2-49e2-a254-d8dff2643b71\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " Jul 14 16:32:16.442211 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.442034 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-service-ca\") pod \"3d31adf1-20e2-49e2-a254-d8dff2643b71\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " Jul 14 16:32:16.442211 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.442055 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-config\") pod \"3d31adf1-20e2-49e2-a254-d8dff2643b71\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " Jul 14 16:32:16.442211 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.442084 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-trusted-ca-bundle\") pod \"3d31adf1-20e2-49e2-a254-d8dff2643b71\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " Jul 14 16:32:16.442211 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.442111 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-oauth-config\") pod \"3d31adf1-20e2-49e2-a254-d8dff2643b71\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " Jul 14 16:32:16.442211 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.442128 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-serving-cert\") pod \"3d31adf1-20e2-49e2-a254-d8dff2643b71\" (UID: \"3d31adf1-20e2-49e2-a254-d8dff2643b71\") " Jul 14 16:32:16.442511 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.442477 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d31adf1-20e2-49e2-a254-d8dff2643b71" (UID: "3d31adf1-20e2-49e2-a254-d8dff2643b71"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:32:16.442511 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.442495 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d31adf1-20e2-49e2-a254-d8dff2643b71" (UID: "3d31adf1-20e2-49e2-a254-d8dff2643b71"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:32:16.442752 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.442583 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-config" (OuterVolumeSpecName: "console-config") pod "3d31adf1-20e2-49e2-a254-d8dff2643b71" (UID: "3d31adf1-20e2-49e2-a254-d8dff2643b71"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:32:16.442820 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.442796 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d31adf1-20e2-49e2-a254-d8dff2643b71" (UID: "3d31adf1-20e2-49e2-a254-d8dff2643b71"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:32:16.444489 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.444457 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d31adf1-20e2-49e2-a254-d8dff2643b71" (UID: "3d31adf1-20e2-49e2-a254-d8dff2643b71"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:32:16.444577 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.444500 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d31adf1-20e2-49e2-a254-d8dff2643b71-kube-api-access-wzlv7" (OuterVolumeSpecName: "kube-api-access-wzlv7") pod "3d31adf1-20e2-49e2-a254-d8dff2643b71" (UID: "3d31adf1-20e2-49e2-a254-d8dff2643b71"). InnerVolumeSpecName "kube-api-access-wzlv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:32:16.444577 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.444508 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d31adf1-20e2-49e2-a254-d8dff2643b71" (UID: "3d31adf1-20e2-49e2-a254-d8dff2643b71"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:32:16.543192 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.543162 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzlv7\" (UniqueName: \"kubernetes.io/projected/3d31adf1-20e2-49e2-a254-d8dff2643b71-kube-api-access-wzlv7\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:16.543192 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.543191 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-oauth-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:16.543364 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.543205 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-service-ca\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:16.543364 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.543218 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:16.543364 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.543226 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d31adf1-20e2-49e2-a254-d8dff2643b71-trusted-ca-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:16.543364 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.543233 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-oauth-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:16.543364 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:16.543241 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d31adf1-20e2-49e2-a254-d8dff2643b71-console-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:32:17.105365 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:17.105331 2564 generic.go:356] "Generic (PLEG): container finished" podID="3d31adf1-20e2-49e2-a254-d8dff2643b71" containerID="730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323" exitCode=0 Jul 14 16:32:17.105832 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:17.105402 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd4d76f7-h5gvw" Jul 14 16:32:17.105832 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:17.105420 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd4d76f7-h5gvw" event={"ID":"3d31adf1-20e2-49e2-a254-d8dff2643b71","Type":"ContainerDied","Data":"730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323"} Jul 14 16:32:17.105832 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:17.105502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd4d76f7-h5gvw" event={"ID":"3d31adf1-20e2-49e2-a254-d8dff2643b71","Type":"ContainerDied","Data":"5c4e72ca59faa7c55727b0f3ce8fa513d1f5d33cb784832218dd1b9158255151"} Jul 14 16:32:17.105832 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:17.105529 2564 scope.go:117] "RemoveContainer" containerID="730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323" Jul 14 16:32:17.113231 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:17.113216 2564 scope.go:117] "RemoveContainer" containerID="730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323" Jul 14 16:32:17.113493 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:32:17.113476 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323\": container with ID starting with 730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323 not found: ID does not exist" containerID="730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323" Jul 14 16:32:17.113534 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:17.113501 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323"} err="failed to get container status \"730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323\": rpc error: code = NotFound desc = could not find container \"730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323\": container with ID starting with 730d529d69d5f47c5853e47d764c6d4d950ed4a73ca26fcb8cf30973c7b18323 not found: ID does not exist" Jul 14 16:32:17.146145 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:17.146115 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd4d76f7-h5gvw"] Jul 14 16:32:17.152517 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:17.152496 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dd4d76f7-h5gvw"] Jul 14 16:32:18.487039 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:18.487010 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d31adf1-20e2-49e2-a254-d8dff2643b71" path="/var/lib/kubelet/pods/3d31adf1-20e2-49e2-a254-d8dff2643b71/volumes" Jul 14 16:32:43.393544 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.393508 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55786f46bb-xzt72"] Jul 14 16:32:43.394029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.393822 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d31adf1-20e2-49e2-a254-d8dff2643b71" containerName="console" Jul 14 16:32:43.394029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.393834 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d31adf1-20e2-49e2-a254-d8dff2643b71" containerName="console" Jul 14 16:32:43.394029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.393847 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1acf56-4172-4f3b-b1af-54026bc1aa98" containerName="console" Jul 14 16:32:43.394029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.393854 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1acf56-4172-4f3b-b1af-54026bc1aa98" containerName="console" Jul 14 16:32:43.394029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.393862 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5c1f566-0512-4b79-9f7c-3e7ba4167f53" containerName="console" Jul 14 16:32:43.394029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.393868 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5c1f566-0512-4b79-9f7c-3e7ba4167f53" containerName="console" Jul 14 16:32:43.394029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.393915 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d31adf1-20e2-49e2-a254-d8dff2643b71" containerName="console" Jul 14 16:32:43.394029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.393923 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5c1f566-0512-4b79-9f7c-3e7ba4167f53" containerName="console" Jul 14 16:32:43.394029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.393934 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f1acf56-4172-4f3b-b1af-54026bc1aa98" containerName="console" Jul 14 16:32:43.398123 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.398106 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.407092 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.407071 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55786f46bb-xzt72"] Jul 14 16:32:43.457039 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.457001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-oauth-config\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.457196 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.457043 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-console-config\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.457196 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.457077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-serving-cert\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.457196 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.457138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-trusted-ca-bundle\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.457196 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.457166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-oauth-serving-cert\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.457196 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.457186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8nsq\" (UniqueName: \"kubernetes.io/projected/d6116b29-0825-47b1-a096-1a861630665a-kube-api-access-p8nsq\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.457424 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.457288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-service-ca\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.558292 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.558250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-oauth-config\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.558292 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.558294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-console-config\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.558552 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.558316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-serving-cert\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.558552 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.558344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-trusted-ca-bundle\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.558552 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.558371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-oauth-serving-cert\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.558552 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.558418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8nsq\" (UniqueName: \"kubernetes.io/projected/d6116b29-0825-47b1-a096-1a861630665a-kube-api-access-p8nsq\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.558552 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.558484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-service-ca\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.559077 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.559054 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-console-config\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.559253 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.559231 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-oauth-serving-cert\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.559296 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.559250 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-service-ca\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.559296 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.559250 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-trusted-ca-bundle\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.560698 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.560678 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-oauth-config\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.560950 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.560932 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-serving-cert\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.568066 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.568047 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8nsq\" (UniqueName: \"kubernetes.io/projected/d6116b29-0825-47b1-a096-1a861630665a-kube-api-access-p8nsq\") pod \"console-55786f46bb-xzt72\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.707327 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.707256 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:43.834150 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:43.834127 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55786f46bb-xzt72"] Jul 14 16:32:43.836617 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:32:43.836592 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6116b29_0825_47b1_a096_1a861630665a.slice/crio-38d58cb1e5613a9dacfc49fb568d928fea8fdcb9b5c428a395815518ae18deee WatchSource:0}: Error finding container 38d58cb1e5613a9dacfc49fb568d928fea8fdcb9b5c428a395815518ae18deee: Status 404 returned error can't find the container with id 38d58cb1e5613a9dacfc49fb568d928fea8fdcb9b5c428a395815518ae18deee Jul 14 16:32:44.210092 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:44.210056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55786f46bb-xzt72" event={"ID":"d6116b29-0825-47b1-a096-1a861630665a","Type":"ContainerStarted","Data":"e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb"} Jul 14 16:32:44.210269 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:44.210110 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55786f46bb-xzt72" event={"ID":"d6116b29-0825-47b1-a096-1a861630665a","Type":"ContainerStarted","Data":"38d58cb1e5613a9dacfc49fb568d928fea8fdcb9b5c428a395815518ae18deee"} Jul 14 16:32:53.708060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:53.708031 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:53.708577 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:53.708120 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:53.713067 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:53.713051 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:53.733437 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:53.733402 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55786f46bb-xzt72" podStartSLOduration=10.733373371999999 podStartE2EDuration="10.733373372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:32:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:32:44.23016846 +0000 UTC m=+155.091557742" watchObservedRunningTime="2026-07-14 16:32:53.733373372 +0000 UTC m=+164.594762656" Jul 14 16:32:54.251115 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:54.251083 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:32:54.309126 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:32:54.309097 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868d77987d-rkqxn"] Jul 14 16:33:19.330443 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.330406 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-868d77987d-rkqxn" podUID="6000834a-539f-4c9f-8be9-56af4cf9cb05" containerName="console" containerID="cri-o://968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07" gracePeriod=15 Jul 14 16:33:19.577619 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.577594 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:33:19.757035 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.756758 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-trusted-ca-bundle\") pod \"6000834a-539f-4c9f-8be9-56af4cf9cb05\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " Jul 14 16:33:19.757035 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.756886 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-config\") pod \"6000834a-539f-4c9f-8be9-56af4cf9cb05\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " Jul 14 16:33:19.757035 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.756947 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-service-ca\") pod \"6000834a-539f-4c9f-8be9-56af4cf9cb05\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " Jul 14 16:33:19.757035 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.757006 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-oauth-config\") pod \"6000834a-539f-4c9f-8be9-56af4cf9cb05\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " Jul 14 16:33:19.757887 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.757755 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6000834a-539f-4c9f-8be9-56af4cf9cb05" (UID: "6000834a-539f-4c9f-8be9-56af4cf9cb05"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:33:19.758006 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.757900 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-config" (OuterVolumeSpecName: "console-config") pod "6000834a-539f-4c9f-8be9-56af4cf9cb05" (UID: "6000834a-539f-4c9f-8be9-56af4cf9cb05"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:33:19.758006 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.757960 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-service-ca" (OuterVolumeSpecName: "service-ca") pod "6000834a-539f-4c9f-8be9-56af4cf9cb05" (UID: "6000834a-539f-4c9f-8be9-56af4cf9cb05"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:33:19.758982 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.758152 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-oauth-serving-cert\") pod \"6000834a-539f-4c9f-8be9-56af4cf9cb05\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " Jul 14 16:33:19.758982 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.758205 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-serving-cert\") pod \"6000834a-539f-4c9f-8be9-56af4cf9cb05\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " Jul 14 16:33:19.758982 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.758287 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q88dr\" (UniqueName: \"kubernetes.io/projected/6000834a-539f-4c9f-8be9-56af4cf9cb05-kube-api-access-q88dr\") pod \"6000834a-539f-4c9f-8be9-56af4cf9cb05\" (UID: \"6000834a-539f-4c9f-8be9-56af4cf9cb05\") " Jul 14 16:33:19.758982 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.758669 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-trusted-ca-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:33:19.758982 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.758687 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:33:19.758982 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.758702 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-service-ca\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:33:19.760726 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.760454 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6000834a-539f-4c9f-8be9-56af4cf9cb05" (UID: "6000834a-539f-4c9f-8be9-56af4cf9cb05"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:33:19.761539 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.761507 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6000834a-539f-4c9f-8be9-56af4cf9cb05-kube-api-access-q88dr" (OuterVolumeSpecName: "kube-api-access-q88dr") pod "6000834a-539f-4c9f-8be9-56af4cf9cb05" (UID: "6000834a-539f-4c9f-8be9-56af4cf9cb05"). InnerVolumeSpecName "kube-api-access-q88dr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:33:19.762541 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.762469 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6000834a-539f-4c9f-8be9-56af4cf9cb05" (UID: "6000834a-539f-4c9f-8be9-56af4cf9cb05"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:33:19.762662 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.762596 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6000834a-539f-4c9f-8be9-56af4cf9cb05" (UID: "6000834a-539f-4c9f-8be9-56af4cf9cb05"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:33:19.859771 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.859750 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-oauth-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:33:19.859771 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.859769 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6000834a-539f-4c9f-8be9-56af4cf9cb05-oauth-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:33:19.859882 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.859779 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6000834a-539f-4c9f-8be9-56af4cf9cb05-console-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:33:19.859882 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:19.859787 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q88dr\" (UniqueName: \"kubernetes.io/projected/6000834a-539f-4c9f-8be9-56af4cf9cb05-kube-api-access-q88dr\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:33:20.347607 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:20.347575 2564 generic.go:356] "Generic (PLEG): container finished" podID="6000834a-539f-4c9f-8be9-56af4cf9cb05" containerID="968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07" exitCode=0 Jul 14 16:33:20.348021 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:20.347633 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868d77987d-rkqxn" Jul 14 16:33:20.348021 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:20.347663 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868d77987d-rkqxn" event={"ID":"6000834a-539f-4c9f-8be9-56af4cf9cb05","Type":"ContainerDied","Data":"968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07"} Jul 14 16:33:20.348021 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:20.347733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868d77987d-rkqxn" event={"ID":"6000834a-539f-4c9f-8be9-56af4cf9cb05","Type":"ContainerDied","Data":"4a175d56d838f615065a726635997288470d8db84bb983e8350e7698fa78f53e"} Jul 14 16:33:20.348021 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:20.347756 2564 scope.go:117] "RemoveContainer" containerID="968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07" Jul 14 16:33:20.356060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:20.356045 2564 scope.go:117] "RemoveContainer" containerID="968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07" Jul 14 16:33:20.356304 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:33:20.356284 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07\": container with ID starting with 968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07 not found: ID does not exist" containerID="968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07" Jul 14 16:33:20.356354 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:20.356312 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07"} err="failed to get container status \"968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07\": rpc error: code = NotFound desc = could not find container \"968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07\": container with ID starting with 968dc09cc52d53018d93f2fcb6d8cf891b7a682239fcf1d937d0afc4d2c5cb07 not found: ID does not exist" Jul 14 16:33:20.369546 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:20.369520 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868d77987d-rkqxn"] Jul 14 16:33:20.371110 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:20.371092 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-868d77987d-rkqxn"] Jul 14 16:33:20.486030 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:20.486003 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6000834a-539f-4c9f-8be9-56af4cf9cb05" path="/var/lib/kubelet/pods/6000834a-539f-4c9f-8be9-56af4cf9cb05/volumes" Jul 14 16:33:30.341447 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.341418 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw"] Jul 14 16:33:30.341875 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.341745 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6000834a-539f-4c9f-8be9-56af4cf9cb05" containerName="console" Jul 14 16:33:30.341875 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.341757 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6000834a-539f-4c9f-8be9-56af4cf9cb05" containerName="console" Jul 14 16:33:30.341875 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.341812 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6000834a-539f-4c9f-8be9-56af4cf9cb05" containerName="console" Jul 14 16:33:30.344656 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.344642 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.347660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.347644 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 16:33:30.347781 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.347765 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4w4zp\"" Jul 14 16:33:30.348688 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.348676 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 16:33:30.356820 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.356800 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw"] Jul 14 16:33:30.435141 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.435113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbc4l\" (UniqueName: \"kubernetes.io/projected/0b011e88-aa58-426c-8e13-263b89fc99fd-kube-api-access-rbc4l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.435251 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.435158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.435251 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.435177 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.536190 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.536159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.536312 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.536194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.536312 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.536240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbc4l\" (UniqueName: \"kubernetes.io/projected/0b011e88-aa58-426c-8e13-263b89fc99fd-kube-api-access-rbc4l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.536599 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.536578 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.536666 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.536601 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.546458 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.546438 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbc4l\" (UniqueName: \"kubernetes.io/projected/0b011e88-aa58-426c-8e13-263b89fc99fd-kube-api-access-rbc4l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.654272 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.654252 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:33:30.805450 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:30.805427 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw"] Jul 14 16:33:30.807866 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:33:30.807842 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b011e88_aa58_426c_8e13_263b89fc99fd.slice/crio-51c7e0dac2e8138b16423affa062f16c3e68eafcc9bb25a74deb95c3b349ac31 WatchSource:0}: Error finding container 51c7e0dac2e8138b16423affa062f16c3e68eafcc9bb25a74deb95c3b349ac31: Status 404 returned error can't find the container with id 51c7e0dac2e8138b16423affa062f16c3e68eafcc9bb25a74deb95c3b349ac31 Jul 14 16:33:31.390302 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:31.390230 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" event={"ID":"0b011e88-aa58-426c-8e13-263b89fc99fd","Type":"ContainerStarted","Data":"51c7e0dac2e8138b16423affa062f16c3e68eafcc9bb25a74deb95c3b349ac31"} Jul 14 16:33:38.422375 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:38.422344 2564 generic.go:356] "Generic (PLEG): container finished" podID="0b011e88-aa58-426c-8e13-263b89fc99fd" containerID="69d6b3ce9c20021a8c45b9cb22800e419a921bac83fe4e8e20474c3d33799469" exitCode=0 Jul 14 16:33:38.422680 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:38.422399 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" event={"ID":"0b011e88-aa58-426c-8e13-263b89fc99fd","Type":"ContainerDied","Data":"69d6b3ce9c20021a8c45b9cb22800e419a921bac83fe4e8e20474c3d33799469"} Jul 14 16:33:59.502375 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:59.502337 2564 generic.go:356] "Generic (PLEG): container finished" podID="0b011e88-aa58-426c-8e13-263b89fc99fd" containerID="8932f6cc1a14b9e3ac41e57a2fb8d99e0edd52820f0af9313787edcdc01e21df" exitCode=0 Jul 14 16:33:59.502796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:33:59.502425 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" event={"ID":"0b011e88-aa58-426c-8e13-263b89fc99fd","Type":"ContainerDied","Data":"8932f6cc1a14b9e3ac41e57a2fb8d99e0edd52820f0af9313787edcdc01e21df"} Jul 14 16:34:07.538201 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:07.538126 2564 generic.go:356] "Generic (PLEG): container finished" podID="0b011e88-aa58-426c-8e13-263b89fc99fd" containerID="0b395f90113ea71adea6845a42ee8c07e1b1196cefd43745c850588f778c1966" exitCode=0 Jul 14 16:34:07.538201 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:07.538172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" event={"ID":"0b011e88-aa58-426c-8e13-263b89fc99fd","Type":"ContainerDied","Data":"0b395f90113ea71adea6845a42ee8c07e1b1196cefd43745c850588f778c1966"} Jul 14 16:34:08.661667 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:08.661642 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:34:08.752079 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:08.752055 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-util\") pod \"0b011e88-aa58-426c-8e13-263b89fc99fd\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " Jul 14 16:34:08.752223 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:08.752117 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-bundle\") pod \"0b011e88-aa58-426c-8e13-263b89fc99fd\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " Jul 14 16:34:08.752223 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:08.752154 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbc4l\" (UniqueName: \"kubernetes.io/projected/0b011e88-aa58-426c-8e13-263b89fc99fd-kube-api-access-rbc4l\") pod \"0b011e88-aa58-426c-8e13-263b89fc99fd\" (UID: \"0b011e88-aa58-426c-8e13-263b89fc99fd\") " Jul 14 16:34:08.752781 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:08.752756 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-bundle" (OuterVolumeSpecName: "bundle") pod "0b011e88-aa58-426c-8e13-263b89fc99fd" (UID: "0b011e88-aa58-426c-8e13-263b89fc99fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:34:08.754280 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:08.754251 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b011e88-aa58-426c-8e13-263b89fc99fd-kube-api-access-rbc4l" (OuterVolumeSpecName: "kube-api-access-rbc4l") pod "0b011e88-aa58-426c-8e13-263b89fc99fd" (UID: "0b011e88-aa58-426c-8e13-263b89fc99fd"). InnerVolumeSpecName "kube-api-access-rbc4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:34:08.756273 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:08.756250 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-util" (OuterVolumeSpecName: "util") pod "0b011e88-aa58-426c-8e13-263b89fc99fd" (UID: "0b011e88-aa58-426c-8e13-263b89fc99fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:34:08.853366 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:08.853310 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:34:08.853366 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:08.853332 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbc4l\" (UniqueName: \"kubernetes.io/projected/0b011e88-aa58-426c-8e13-263b89fc99fd-kube-api-access-rbc4l\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:34:08.853366 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:08.853342 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b011e88-aa58-426c-8e13-263b89fc99fd-util\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:34:09.546575 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:09.546540 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" event={"ID":"0b011e88-aa58-426c-8e13-263b89fc99fd","Type":"ContainerDied","Data":"51c7e0dac2e8138b16423affa062f16c3e68eafcc9bb25a74deb95c3b349ac31"} Jul 14 16:34:09.546752 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:09.546596 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407b2rw" Jul 14 16:34:09.546752 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:09.546596 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51c7e0dac2e8138b16423affa062f16c3e68eafcc9bb25a74deb95c3b349ac31" Jul 14 16:34:13.639966 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.639935 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q"] Jul 14 16:34:13.640369 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.640235 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b011e88-aa58-426c-8e13-263b89fc99fd" containerName="pull" Jul 14 16:34:13.640369 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.640246 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b011e88-aa58-426c-8e13-263b89fc99fd" containerName="pull" Jul 14 16:34:13.640369 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.640255 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b011e88-aa58-426c-8e13-263b89fc99fd" containerName="extract" Jul 14 16:34:13.640369 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.640262 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b011e88-aa58-426c-8e13-263b89fc99fd" containerName="extract" Jul 14 16:34:13.640369 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.640268 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b011e88-aa58-426c-8e13-263b89fc99fd" containerName="util" Jul 14 16:34:13.640369 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.640273 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b011e88-aa58-426c-8e13-263b89fc99fd" containerName="util" Jul 14 16:34:13.640369 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.640326 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b011e88-aa58-426c-8e13-263b89fc99fd" containerName="extract" Jul 14 16:34:13.644499 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.644482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" Jul 14 16:34:13.647225 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.647200 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:34:13.647225 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.647222 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 14 16:34:13.647435 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.647233 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ltvm7\"" Jul 14 16:34:13.656368 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.656346 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q"] Jul 14 16:34:13.786874 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.786836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0cb089e-2252-4f02-8104-cc3f2b06c132-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x7x4q\" (UID: \"f0cb089e-2252-4f02-8104-cc3f2b06c132\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" Jul 14 16:34:13.787049 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.786888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcq7c\" (UniqueName: \"kubernetes.io/projected/f0cb089e-2252-4f02-8104-cc3f2b06c132-kube-api-access-xcq7c\") pod \"cert-manager-operator-controller-manager-55c444bf86-x7x4q\" (UID: \"f0cb089e-2252-4f02-8104-cc3f2b06c132\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" Jul 14 16:34:13.887951 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.887912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0cb089e-2252-4f02-8104-cc3f2b06c132-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x7x4q\" (UID: \"f0cb089e-2252-4f02-8104-cc3f2b06c132\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" Jul 14 16:34:13.888133 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.887965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcq7c\" (UniqueName: \"kubernetes.io/projected/f0cb089e-2252-4f02-8104-cc3f2b06c132-kube-api-access-xcq7c\") pod \"cert-manager-operator-controller-manager-55c444bf86-x7x4q\" (UID: \"f0cb089e-2252-4f02-8104-cc3f2b06c132\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" Jul 14 16:34:13.888315 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.888296 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0cb089e-2252-4f02-8104-cc3f2b06c132-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x7x4q\" (UID: \"f0cb089e-2252-4f02-8104-cc3f2b06c132\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" Jul 14 16:34:13.897768 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.897704 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcq7c\" (UniqueName: \"kubernetes.io/projected/f0cb089e-2252-4f02-8104-cc3f2b06c132-kube-api-access-xcq7c\") pod \"cert-manager-operator-controller-manager-55c444bf86-x7x4q\" (UID: \"f0cb089e-2252-4f02-8104-cc3f2b06c132\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" Jul 14 16:34:13.953892 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:13.953855 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" Jul 14 16:34:14.093763 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:14.093724 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q"] Jul 14 16:34:14.097248 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:34:14.097215 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0cb089e_2252_4f02_8104_cc3f2b06c132.slice/crio-b5eafeab0df52243de5ef8a866b9a8e3b98f93e8c464df58320cd3e90fbe113b WatchSource:0}: Error finding container b5eafeab0df52243de5ef8a866b9a8e3b98f93e8c464df58320cd3e90fbe113b: Status 404 returned error can't find the container with id b5eafeab0df52243de5ef8a866b9a8e3b98f93e8c464df58320cd3e90fbe113b Jul 14 16:34:14.567768 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:14.567734 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" event={"ID":"f0cb089e-2252-4f02-8104-cc3f2b06c132","Type":"ContainerStarted","Data":"b5eafeab0df52243de5ef8a866b9a8e3b98f93e8c464df58320cd3e90fbe113b"} Jul 14 16:34:32.651795 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:32.651756 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" event={"ID":"f0cb089e-2252-4f02-8104-cc3f2b06c132","Type":"ContainerStarted","Data":"a468667882b40f248898eab746d2814b3fcd94de33b1f34eaa238c713cbdc6a3"} Jul 14 16:34:32.676514 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:32.676466 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x7x4q" podStartSLOduration=1.527539075 podStartE2EDuration="19.676448735s" totalImagesPullingTime="18.14890966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:34:32.674318005 +0000 UTC m=+263.535707299" watchObservedRunningTime="2026-07-14 16:34:32.676448735 +0000 UTC m=+263.537838018" Jul 14 16:34:33.323909 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.323878 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rxrw7"] Jul 14 16:34:33.327098 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.327081 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" Jul 14 16:34:33.330581 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.330560 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 16:34:33.330803 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.330786 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 16:34:33.333665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.333459 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29wn\" (UniqueName: \"kubernetes.io/projected/82d35b02-2186-4632-a572-00bcef6e4e78-kube-api-access-q29wn\") pod \"cert-manager-webhook-6486ffd997-rxrw7\" (UID: \"82d35b02-2186-4632-a572-00bcef6e4e78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" Jul 14 16:34:33.333665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.333502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82d35b02-2186-4632-a572-00bcef6e4e78-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rxrw7\" (UID: \"82d35b02-2186-4632-a572-00bcef6e4e78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" Jul 14 16:34:33.341210 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.341190 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rxrw7"] Jul 14 16:34:33.385869 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.385839 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h"] Jul 14 16:34:33.389149 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.389133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.396705 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.396685 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 16:34:33.396822 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.396686 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 16:34:33.396890 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.396864 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4w4zp\"" Jul 14 16:34:33.422532 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.422508 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h"] Jul 14 16:34:33.434099 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.434075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q29wn\" (UniqueName: \"kubernetes.io/projected/82d35b02-2186-4632-a572-00bcef6e4e78-kube-api-access-q29wn\") pod \"cert-manager-webhook-6486ffd997-rxrw7\" (UID: \"82d35b02-2186-4632-a572-00bcef6e4e78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" Jul 14 16:34:33.434218 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.434111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnjm4\" (UniqueName: \"kubernetes.io/projected/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-kube-api-access-lnjm4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.434218 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.434138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.434218 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.434184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82d35b02-2186-4632-a572-00bcef6e4e78-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rxrw7\" (UID: \"82d35b02-2186-4632-a572-00bcef6e4e78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" Jul 14 16:34:33.434371 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.434249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.447928 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.447904 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82d35b02-2186-4632-a572-00bcef6e4e78-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rxrw7\" (UID: \"82d35b02-2186-4632-a572-00bcef6e4e78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" Jul 14 16:34:33.449202 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.448584 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29wn\" (UniqueName: \"kubernetes.io/projected/82d35b02-2186-4632-a572-00bcef6e4e78-kube-api-access-q29wn\") pod \"cert-manager-webhook-6486ffd997-rxrw7\" (UID: \"82d35b02-2186-4632-a572-00bcef6e4e78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" Jul 14 16:34:33.535537 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.535500 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnjm4\" (UniqueName: \"kubernetes.io/projected/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-kube-api-access-lnjm4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.535537 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.535537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.535778 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.535576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.535971 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.535951 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.536050 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.535978 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.564984 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.564952 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnjm4\" (UniqueName: \"kubernetes.io/projected/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-kube-api-access-lnjm4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.643059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.643037 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" Jul 14 16:34:33.698463 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.698436 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:33.783520 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.783308 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rxrw7"] Jul 14 16:34:33.785768 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:34:33.785737 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82d35b02_2186_4632_a572_00bcef6e4e78.slice/crio-c5d4958bbf82930d294a0c1db2f1f11b3c05fd3de0af38cefefbe0e8c769ac61 WatchSource:0}: Error finding container c5d4958bbf82930d294a0c1db2f1f11b3c05fd3de0af38cefefbe0e8c769ac61: Status 404 returned error can't find the container with id c5d4958bbf82930d294a0c1db2f1f11b3c05fd3de0af38cefefbe0e8c769ac61 Jul 14 16:34:33.839153 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:33.836189 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h"] Jul 14 16:34:34.661370 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:34.661331 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" event={"ID":"82d35b02-2186-4632-a572-00bcef6e4e78","Type":"ContainerStarted","Data":"c5d4958bbf82930d294a0c1db2f1f11b3c05fd3de0af38cefefbe0e8c769ac61"} Jul 14 16:34:34.662678 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:34.662652 2564 generic.go:356] "Generic (PLEG): container finished" podID="a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" containerID="b5d0ed9af2e27a146f1da78549dc129790479ecbda77ade1cbe3cda8393a0ce0" exitCode=0 Jul 14 16:34:34.662796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:34.662744 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" event={"ID":"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44","Type":"ContainerDied","Data":"b5d0ed9af2e27a146f1da78549dc129790479ecbda77ade1cbe3cda8393a0ce0"} Jul 14 16:34:34.662840 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:34.662793 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" event={"ID":"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44","Type":"ContainerStarted","Data":"76e3fa41f6b50eae275a5728bb09135722d1c55832b27c20bdcda47b7acc22a4"} Jul 14 16:34:37.677816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:37.677784 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" event={"ID":"82d35b02-2186-4632-a572-00bcef6e4e78","Type":"ContainerStarted","Data":"89f1f1591f5252dc8d908e20040273e1d1e311c0305807ed580fa91c57b7bd9e"} Jul 14 16:34:37.678202 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:37.677904 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" Jul 14 16:34:37.700596 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:37.700547 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" podStartSLOduration=1.732286059 podStartE2EDuration="4.700531241s" totalImagesPullingTime="2.968245182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:34:37.699407235 +0000 UTC m=+268.560796515" watchObservedRunningTime="2026-07-14 16:34:37.700531241 +0000 UTC m=+268.561920524" Jul 14 16:34:43.684805 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:43.684776 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rxrw7" Jul 14 16:34:45.967769 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:45.967734 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7wzhs"] Jul 14 16:34:45.971775 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:45.971752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7wzhs" Jul 14 16:34:45.974414 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:45.974369 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ndwf6\"" Jul 14 16:34:45.981114 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:45.981094 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7wzhs"] Jul 14 16:34:46.030406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.030359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx48g\" (UniqueName: \"kubernetes.io/projected/f28e4ed7-2199-40f3-aa49-619fd6127034-kube-api-access-bx48g\") pod \"cert-manager-55b4d954d5-7wzhs\" (UID: \"f28e4ed7-2199-40f3-aa49-619fd6127034\") " pod="cert-manager/cert-manager-55b4d954d5-7wzhs" Jul 14 16:34:46.030563 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.030489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f28e4ed7-2199-40f3-aa49-619fd6127034-bound-sa-token\") pod \"cert-manager-55b4d954d5-7wzhs\" (UID: \"f28e4ed7-2199-40f3-aa49-619fd6127034\") " pod="cert-manager/cert-manager-55b4d954d5-7wzhs" Jul 14 16:34:46.131542 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.131507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f28e4ed7-2199-40f3-aa49-619fd6127034-bound-sa-token\") pod \"cert-manager-55b4d954d5-7wzhs\" (UID: \"f28e4ed7-2199-40f3-aa49-619fd6127034\") " pod="cert-manager/cert-manager-55b4d954d5-7wzhs" Jul 14 16:34:46.131686 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.131574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx48g\" (UniqueName: \"kubernetes.io/projected/f28e4ed7-2199-40f3-aa49-619fd6127034-kube-api-access-bx48g\") pod \"cert-manager-55b4d954d5-7wzhs\" (UID: \"f28e4ed7-2199-40f3-aa49-619fd6127034\") " pod="cert-manager/cert-manager-55b4d954d5-7wzhs" Jul 14 16:34:46.156205 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.156174 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f28e4ed7-2199-40f3-aa49-619fd6127034-bound-sa-token\") pod \"cert-manager-55b4d954d5-7wzhs\" (UID: \"f28e4ed7-2199-40f3-aa49-619fd6127034\") " pod="cert-manager/cert-manager-55b4d954d5-7wzhs" Jul 14 16:34:46.156335 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.156228 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx48g\" (UniqueName: \"kubernetes.io/projected/f28e4ed7-2199-40f3-aa49-619fd6127034-kube-api-access-bx48g\") pod \"cert-manager-55b4d954d5-7wzhs\" (UID: \"f28e4ed7-2199-40f3-aa49-619fd6127034\") " pod="cert-manager/cert-manager-55b4d954d5-7wzhs" Jul 14 16:34:46.281545 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.281451 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7wzhs" Jul 14 16:34:46.411763 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.411729 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7wzhs"] Jul 14 16:34:46.415041 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:34:46.415012 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf28e4ed7_2199_40f3_aa49_619fd6127034.slice/crio-1eca1cf07394ff566c4243ff728c6bc3d8896e06a326ba050aec43c2e9119261 WatchSource:0}: Error finding container 1eca1cf07394ff566c4243ff728c6bc3d8896e06a326ba050aec43c2e9119261: Status 404 returned error can't find the container with id 1eca1cf07394ff566c4243ff728c6bc3d8896e06a326ba050aec43c2e9119261 Jul 14 16:34:46.717803 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.717769 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7wzhs" event={"ID":"f28e4ed7-2199-40f3-aa49-619fd6127034","Type":"ContainerStarted","Data":"c38c3bd19f477d1c36236ae12037d5416662869301542ed63cb400dbce310b99"} Jul 14 16:34:46.717980 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.717812 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7wzhs" event={"ID":"f28e4ed7-2199-40f3-aa49-619fd6127034","Type":"ContainerStarted","Data":"1eca1cf07394ff566c4243ff728c6bc3d8896e06a326ba050aec43c2e9119261"} Jul 14 16:34:46.735773 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:46.735722 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7wzhs" podStartSLOduration=1.735707037 podStartE2EDuration="1.735707037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:34:46.735156193 +0000 UTC m=+277.596545487" watchObservedRunningTime="2026-07-14 16:34:46.735707037 +0000 UTC m=+277.597096320" Jul 14 16:34:49.733223 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:49.733186 2564 generic.go:356] "Generic (PLEG): container finished" podID="a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" containerID="b8be9cb2e138f1cc1416920bdb54cfb7a7c720ded761d1690b64c43ebd2b073b" exitCode=0 Jul 14 16:34:49.733717 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:49.733240 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" event={"ID":"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44","Type":"ContainerDied","Data":"b8be9cb2e138f1cc1416920bdb54cfb7a7c720ded761d1690b64c43ebd2b073b"} Jul 14 16:34:50.740093 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:50.740061 2564 generic.go:356] "Generic (PLEG): container finished" podID="a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" containerID="26a2da4ad1946e3b53e93b59b0ef96632299817ecf9614e839b38e6f1688db5b" exitCode=0 Jul 14 16:34:50.740499 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:50.740132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" event={"ID":"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44","Type":"ContainerDied","Data":"26a2da4ad1946e3b53e93b59b0ef96632299817ecf9614e839b38e6f1688db5b"} Jul 14 16:34:51.872231 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:51.872204 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:51.977157 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:51.977131 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnjm4\" (UniqueName: \"kubernetes.io/projected/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-kube-api-access-lnjm4\") pod \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " Jul 14 16:34:51.977339 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:51.977168 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-util\") pod \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " Jul 14 16:34:51.977339 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:51.977191 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-bundle\") pod \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\" (UID: \"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44\") " Jul 14 16:34:51.977656 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:51.977630 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-bundle" (OuterVolumeSpecName: "bundle") pod "a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" (UID: "a28238a0-fe6f-4fbf-aa0e-a9cac8403b44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:34:51.979218 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:51.979188 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-kube-api-access-lnjm4" (OuterVolumeSpecName: "kube-api-access-lnjm4") pod "a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" (UID: "a28238a0-fe6f-4fbf-aa0e-a9cac8403b44"). InnerVolumeSpecName "kube-api-access-lnjm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:34:51.983533 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:51.983503 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-util" (OuterVolumeSpecName: "util") pod "a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" (UID: "a28238a0-fe6f-4fbf-aa0e-a9cac8403b44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:34:52.078480 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:52.078376 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnjm4\" (UniqueName: \"kubernetes.io/projected/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-kube-api-access-lnjm4\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:34:52.078480 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:52.078425 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-util\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:34:52.078480 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:52.078437 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a28238a0-fe6f-4fbf-aa0e-a9cac8403b44-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:34:52.751155 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:52.751085 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" Jul 14 16:34:52.751277 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:52.751078 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffgz6h" event={"ID":"a28238a0-fe6f-4fbf-aa0e-a9cac8403b44","Type":"ContainerDied","Data":"76e3fa41f6b50eae275a5728bb09135722d1c55832b27c20bdcda47b7acc22a4"} Jul 14 16:34:52.751277 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:34:52.751205 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76e3fa41f6b50eae275a5728bb09135722d1c55832b27c20bdcda47b7acc22a4" Jul 14 16:35:01.822657 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.822627 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt"] Jul 14 16:35:01.823003 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.822917 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" containerName="util" Jul 14 16:35:01.823003 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.822928 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" containerName="util" Jul 14 16:35:01.823003 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.822940 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" containerName="extract" Jul 14 16:35:01.823003 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.822946 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" containerName="extract" Jul 14 16:35:01.823003 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.822959 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" containerName="pull" Jul 14 16:35:01.823003 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.822964 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" containerName="pull" Jul 14 16:35:01.823181 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.823014 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a28238a0-fe6f-4fbf-aa0e-a9cac8403b44" containerName="extract" Jul 14 16:35:01.829470 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.829443 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:01.832448 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.832424 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4w4zp\"" Jul 14 16:35:01.832568 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.832470 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 16:35:01.833423 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.833403 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 16:35:01.837358 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.837335 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt"] Jul 14 16:35:01.954184 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.954149 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:01.954364 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.954211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:01.954364 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:01.954236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k4s7\" (UniqueName: \"kubernetes.io/projected/34b1f225-d418-4700-8164-2addc72e6d85-kube-api-access-8k4s7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:02.054720 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.054690 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:02.054899 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.054726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k4s7\" (UniqueName: \"kubernetes.io/projected/34b1f225-d418-4700-8164-2addc72e6d85-kube-api-access-8k4s7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:02.054899 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.054772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:02.055119 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.055085 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:02.055186 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.055117 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:02.065792 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.065757 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k4s7\" (UniqueName: \"kubernetes.io/projected/34b1f225-d418-4700-8164-2addc72e6d85-kube-api-access-8k4s7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:02.139899 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.139818 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:02.269238 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.269206 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt"] Jul 14 16:35:02.272054 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:35:02.272033 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b1f225_d418_4700_8164_2addc72e6d85.slice/crio-b63562b2f86ee8e88a4d882aecd7a0b380006b2fd63000fcf6250cdaba17d005 WatchSource:0}: Error finding container b63562b2f86ee8e88a4d882aecd7a0b380006b2fd63000fcf6250cdaba17d005: Status 404 returned error can't find the container with id b63562b2f86ee8e88a4d882aecd7a0b380006b2fd63000fcf6250cdaba17d005 Jul 14 16:35:02.794899 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.794865 2564 generic.go:356] "Generic (PLEG): container finished" podID="34b1f225-d418-4700-8164-2addc72e6d85" containerID="f6021f3248feadcc31c73c18c4f20f2d89f4f8dfe5fe9f6b1587b8b84c0b1ae2" exitCode=0 Jul 14 16:35:02.795073 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.794900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" event={"ID":"34b1f225-d418-4700-8164-2addc72e6d85","Type":"ContainerDied","Data":"f6021f3248feadcc31c73c18c4f20f2d89f4f8dfe5fe9f6b1587b8b84c0b1ae2"} Jul 14 16:35:02.795073 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:02.794948 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" event={"ID":"34b1f225-d418-4700-8164-2addc72e6d85","Type":"ContainerStarted","Data":"b63562b2f86ee8e88a4d882aecd7a0b380006b2fd63000fcf6250cdaba17d005"} Jul 14 16:35:04.805588 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:04.805546 2564 generic.go:356] "Generic (PLEG): container finished" podID="34b1f225-d418-4700-8164-2addc72e6d85" containerID="31399cdd8f3e910d150d159fac6f4963e0e58eb6773b6aa3dcbbb9ef36d3f73d" exitCode=0 Jul 14 16:35:04.805944 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:04.805602 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" event={"ID":"34b1f225-d418-4700-8164-2addc72e6d85","Type":"ContainerDied","Data":"31399cdd8f3e910d150d159fac6f4963e0e58eb6773b6aa3dcbbb9ef36d3f73d"} Jul 14 16:35:05.811805 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:05.811768 2564 generic.go:356] "Generic (PLEG): container finished" podID="34b1f225-d418-4700-8164-2addc72e6d85" containerID="a206588fc928a0e7f5705ab0a2a6dea2dbc058769098af3a5b5b19c8516c680c" exitCode=0 Jul 14 16:35:05.812174 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:05.811855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" event={"ID":"34b1f225-d418-4700-8164-2addc72e6d85","Type":"ContainerDied","Data":"a206588fc928a0e7f5705ab0a2a6dea2dbc058769098af3a5b5b19c8516c680c"} Jul 14 16:35:06.946982 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:06.946954 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:06.997314 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:06.997278 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k4s7\" (UniqueName: \"kubernetes.io/projected/34b1f225-d418-4700-8164-2addc72e6d85-kube-api-access-8k4s7\") pod \"34b1f225-d418-4700-8164-2addc72e6d85\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " Jul 14 16:35:06.997505 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:06.997330 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-bundle\") pod \"34b1f225-d418-4700-8164-2addc72e6d85\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " Jul 14 16:35:06.997573 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:06.997527 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-util\") pod \"34b1f225-d418-4700-8164-2addc72e6d85\" (UID: \"34b1f225-d418-4700-8164-2addc72e6d85\") " Jul 14 16:35:06.998063 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:06.998036 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-bundle" (OuterVolumeSpecName: "bundle") pod "34b1f225-d418-4700-8164-2addc72e6d85" (UID: "34b1f225-d418-4700-8164-2addc72e6d85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:35:06.999437 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:06.999421 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34b1f225-d418-4700-8164-2addc72e6d85-kube-api-access-8k4s7" (OuterVolumeSpecName: "kube-api-access-8k4s7") pod "34b1f225-d418-4700-8164-2addc72e6d85" (UID: "34b1f225-d418-4700-8164-2addc72e6d85"). InnerVolumeSpecName "kube-api-access-8k4s7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:35:07.003360 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:07.003337 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-util" (OuterVolumeSpecName: "util") pod "34b1f225-d418-4700-8164-2addc72e6d85" (UID: "34b1f225-d418-4700-8164-2addc72e6d85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:35:07.098708 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:07.098628 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:35:07.098708 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:07.098657 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34b1f225-d418-4700-8164-2addc72e6d85-util\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:35:07.098708 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:07.098666 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k4s7\" (UniqueName: \"kubernetes.io/projected/34b1f225-d418-4700-8164-2addc72e6d85-kube-api-access-8k4s7\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:35:07.822234 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:07.822208 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" Jul 14 16:35:07.822450 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:07.822202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrnwgt" event={"ID":"34b1f225-d418-4700-8164-2addc72e6d85","Type":"ContainerDied","Data":"b63562b2f86ee8e88a4d882aecd7a0b380006b2fd63000fcf6250cdaba17d005"} Jul 14 16:35:07.822450 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:07.822332 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b63562b2f86ee8e88a4d882aecd7a0b380006b2fd63000fcf6250cdaba17d005" Jul 14 16:35:09.453715 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:09.453687 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 16:35:14.859919 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.859880 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq"] Jul 14 16:35:14.862406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.860330 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b1f225-d418-4700-8164-2addc72e6d85" containerName="util" Jul 14 16:35:14.862406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.860349 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b1f225-d418-4700-8164-2addc72e6d85" containerName="util" Jul 14 16:35:14.862406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.860358 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b1f225-d418-4700-8164-2addc72e6d85" containerName="extract" Jul 14 16:35:14.862406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.860364 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b1f225-d418-4700-8164-2addc72e6d85" containerName="extract" Jul 14 16:35:14.862406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.860373 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b1f225-d418-4700-8164-2addc72e6d85" containerName="pull" Jul 14 16:35:14.862406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.860378 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b1f225-d418-4700-8164-2addc72e6d85" containerName="pull" Jul 14 16:35:14.862406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.860456 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="34b1f225-d418-4700-8164-2addc72e6d85" containerName="extract" Jul 14 16:35:14.863421 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.863330 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:14.868178 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.868150 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 16:35:14.868303 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.868174 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 16:35:14.868435 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.868406 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bkcjj\"" Jul 14 16:35:14.868557 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.868542 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 16:35:14.868645 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.868631 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 16:35:14.881734 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.881701 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq"] Jul 14 16:35:14.956783 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.956756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfa645c-857e-4876-8329-38243f6c64e7-tmp\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:14.956908 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.956786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccfa645c-857e-4876-8329-38243f6c64e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:14.956908 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.956833 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccfa645c-857e-4876-8329-38243f6c64e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:14.956908 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.956856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccfa645c-857e-4876-8329-38243f6c64e7-manifests\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:14.956908 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:14.956889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md4wl\" (UniqueName: \"kubernetes.io/projected/ccfa645c-857e-4876-8329-38243f6c64e7-kube-api-access-md4wl\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.057782 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.057747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccfa645c-857e-4876-8329-38243f6c64e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.057782 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.057784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccfa645c-857e-4876-8329-38243f6c64e7-manifests\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.057936 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.057914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md4wl\" (UniqueName: \"kubernetes.io/projected/ccfa645c-857e-4876-8329-38243f6c64e7-kube-api-access-md4wl\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.057996 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.057983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfa645c-857e-4876-8329-38243f6c64e7-tmp\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.058030 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.058004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccfa645c-857e-4876-8329-38243f6c64e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.058208 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.058180 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccfa645c-857e-4876-8329-38243f6c64e7-manifests\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.060085 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.060064 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfa645c-857e-4876-8329-38243f6c64e7-tmp\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.060288 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.060272 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccfa645c-857e-4876-8329-38243f6c64e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.060454 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.060434 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccfa645c-857e-4876-8329-38243f6c64e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.069560 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.069538 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md4wl\" (UniqueName: \"kubernetes.io/projected/ccfa645c-857e-4876-8329-38243f6c64e7-kube-api-access-md4wl\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq\" (UID: \"ccfa645c-857e-4876-8329-38243f6c64e7\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.173317 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.173287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:15.324998 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.324837 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq"] Jul 14 16:35:15.327977 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:35:15.327951 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccfa645c_857e_4876_8329_38243f6c64e7.slice/crio-d311e03f5029a34b8e3fe6d96a5cf345a3da87299e25c22985aa21062f90573f WatchSource:0}: Error finding container d311e03f5029a34b8e3fe6d96a5cf345a3da87299e25c22985aa21062f90573f: Status 404 returned error can't find the container with id d311e03f5029a34b8e3fe6d96a5cf345a3da87299e25c22985aa21062f90573f Jul 14 16:35:15.330358 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.330339 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 16:35:15.858826 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:15.858788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" event={"ID":"ccfa645c-857e-4876-8329-38243f6c64e7","Type":"ContainerStarted","Data":"d311e03f5029a34b8e3fe6d96a5cf345a3da87299e25c22985aa21062f90573f"} Jul 14 16:35:18.877138 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:18.877100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" event={"ID":"ccfa645c-857e-4876-8329-38243f6c64e7","Type":"ContainerStarted","Data":"65dd368c21dd95b6b2d00bf62baf0a8c67f42526d13b662fbd279644e91d9689"} Jul 14 16:35:19.882916 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:19.882824 2564 generic.go:356] "Generic (PLEG): container finished" podID="ccfa645c-857e-4876-8329-38243f6c64e7" containerID="65dd368c21dd95b6b2d00bf62baf0a8c67f42526d13b662fbd279644e91d9689" exitCode=0 Jul 14 16:35:19.883313 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:19.882906 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" event={"ID":"ccfa645c-857e-4876-8329-38243f6c64e7","Type":"ContainerDied","Data":"65dd368c21dd95b6b2d00bf62baf0a8c67f42526d13b662fbd279644e91d9689"} Jul 14 16:35:21.894693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:21.894659 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" event={"ID":"ccfa645c-857e-4876-8329-38243f6c64e7","Type":"ContainerStarted","Data":"a7e755d379fa6895f59c8d40e0e71b8ba04113726ca2c7dfe23502ad33d1038d"} Jul 14 16:35:21.895089 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:21.894774 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:21.952990 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:21.952946 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" podStartSLOduration=2.843828998 podStartE2EDuration="7.952930292s" totalImagesPullingTime="4.024898936s" totalInitContainerRuntime="1.084202358s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:21.951545123 +0000 UTC m=+312.812934406" watchObservedRunningTime="2026-07-14 16:35:21.952930292 +0000 UTC m=+312.814319588" Jul 14 16:35:32.902048 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:32.902021 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq" Jul 14 16:35:35.231603 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.231571 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj"] Jul 14 16:35:35.234830 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.234814 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.238434 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.238403 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 16:35:35.238434 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.238416 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 16:35:35.238623 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.238435 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 16:35:35.238623 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.238459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 16:35:35.238939 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.238925 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tbmvd\"" Jul 14 16:35:35.239032 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.238956 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:35:35.248275 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.248252 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj"] Jul 14 16:35:35.329755 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.329723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/683f983e-9ed2-4dab-924f-6920f4574e58-metrics-cert\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.329755 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.329759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzpkn\" (UniqueName: \"kubernetes.io/projected/683f983e-9ed2-4dab-924f-6920f4574e58-kube-api-access-vzpkn\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.329933 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.329780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/683f983e-9ed2-4dab-924f-6920f4574e58-cert\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.329933 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.329823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/683f983e-9ed2-4dab-924f-6920f4574e58-manager-config\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.430368 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.430339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/683f983e-9ed2-4dab-924f-6920f4574e58-metrics-cert\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.430368 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.430370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzpkn\" (UniqueName: \"kubernetes.io/projected/683f983e-9ed2-4dab-924f-6920f4574e58-kube-api-access-vzpkn\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.430575 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.430415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/683f983e-9ed2-4dab-924f-6920f4574e58-cert\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.430575 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.430440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/683f983e-9ed2-4dab-924f-6920f4574e58-manager-config\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.431141 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.431113 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/683f983e-9ed2-4dab-924f-6920f4574e58-manager-config\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.432890 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.432868 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/683f983e-9ed2-4dab-924f-6920f4574e58-cert\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.433083 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.433061 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/683f983e-9ed2-4dab-924f-6920f4574e58-metrics-cert\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.450372 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.450347 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzpkn\" (UniqueName: \"kubernetes.io/projected/683f983e-9ed2-4dab-924f-6920f4574e58-kube-api-access-vzpkn\") pod \"lws-controller-manager-7889f65889-hxvfj\" (UID: \"683f983e-9ed2-4dab-924f-6920f4574e58\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.544705 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.544636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:35.781118 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:35:35.781087 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683f983e_9ed2_4dab_924f_6920f4574e58.slice/crio-3c17d06a2a6a4bff84a99566ac71fdf08ed76f51ce1812edc2e42b6ac25974c4 WatchSource:0}: Error finding container 3c17d06a2a6a4bff84a99566ac71fdf08ed76f51ce1812edc2e42b6ac25974c4: Status 404 returned error can't find the container with id 3c17d06a2a6a4bff84a99566ac71fdf08ed76f51ce1812edc2e42b6ac25974c4 Jul 14 16:35:35.781628 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.781599 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj"] Jul 14 16:35:35.959411 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:35.959360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" event={"ID":"683f983e-9ed2-4dab-924f-6920f4574e58","Type":"ContainerStarted","Data":"3c17d06a2a6a4bff84a99566ac71fdf08ed76f51ce1812edc2e42b6ac25974c4"} Jul 14 16:35:37.969741 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:37.969708 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" event={"ID":"683f983e-9ed2-4dab-924f-6920f4574e58","Type":"ContainerStarted","Data":"0d81af5f134d3c063fe1a9a9fd3131083800c651ef081567f1970d5b481c954b"} Jul 14 16:35:37.970096 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:37.969761 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:41.103778 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.103716 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" podStartSLOduration=4.413430279 podStartE2EDuration="6.103694582s" totalImagesPullingTime="1.690264303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:38.005146429 +0000 UTC m=+328.866535713" watchObservedRunningTime="2026-07-14 16:35:41.103694582 +0000 UTC m=+331.965083867" Jul 14 16:35:41.104799 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.104772 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw"] Jul 14 16:35:41.108589 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.108569 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:41.114588 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.114567 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 16:35:41.115370 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.115331 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 16:35:41.115498 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.115363 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 16:35:41.115770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.115750 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7gslv\"" Jul 14 16:35:41.116109 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.116093 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 16:35:41.125541 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.125518 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw"] Jul 14 16:35:41.177425 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.177375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7f5p\" (UniqueName: \"kubernetes.io/projected/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-kube-api-access-t7f5p\") pod \"kube-auth-proxy-7f68dcd7b8-kf6dw\" (UID: \"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:41.177553 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.177436 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-tmp\") pod \"kube-auth-proxy-7f68dcd7b8-kf6dw\" (UID: \"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:41.177553 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.177456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-tls-certs\") pod \"kube-auth-proxy-7f68dcd7b8-kf6dw\" (UID: \"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:41.278567 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.278533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7f5p\" (UniqueName: \"kubernetes.io/projected/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-kube-api-access-t7f5p\") pod \"kube-auth-proxy-7f68dcd7b8-kf6dw\" (UID: \"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:41.278726 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.278570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-tmp\") pod \"kube-auth-proxy-7f68dcd7b8-kf6dw\" (UID: \"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:41.278726 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.278593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-tls-certs\") pod \"kube-auth-proxy-7f68dcd7b8-kf6dw\" (UID: \"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:41.278726 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:35:41.278703 2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 14 16:35:41.278873 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:35:41.278757 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-tls-certs podName:18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee nodeName:}" failed. No retries permitted until 2026-07-14 16:35:41.778741254 +0000 UTC m=+332.640130515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-tls-certs") pod "kube-auth-proxy-7f68dcd7b8-kf6dw" (UID: "18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee") : secret "kube-auth-proxy-tls" not found Jul 14 16:35:41.280751 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.280726 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-tmp\") pod \"kube-auth-proxy-7f68dcd7b8-kf6dw\" (UID: \"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:41.289696 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.289673 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7f5p\" (UniqueName: \"kubernetes.io/projected/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-kube-api-access-t7f5p\") pod \"kube-auth-proxy-7f68dcd7b8-kf6dw\" (UID: \"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:41.782996 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.782963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-tls-certs\") pod \"kube-auth-proxy-7f68dcd7b8-kf6dw\" (UID: \"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:41.785454 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:41.785437 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee-tls-certs\") pod \"kube-auth-proxy-7f68dcd7b8-kf6dw\" (UID: \"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee\") " pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:42.017964 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:42.017920 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" Jul 14 16:35:42.163639 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:42.163608 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw"] Jul 14 16:35:42.167020 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:35:42.166993 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18cca59e_9eb3_4ea9_aa7c_41ae27e2c4ee.slice/crio-46f36f5d6a2d3a3118bd884a1c524af3b258f8236d8a1895c61ee8c41094272a WatchSource:0}: Error finding container 46f36f5d6a2d3a3118bd884a1c524af3b258f8236d8a1895c61ee8c41094272a: Status 404 returned error can't find the container with id 46f36f5d6a2d3a3118bd884a1c524af3b258f8236d8a1895c61ee8c41094272a Jul 14 16:35:42.992666 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:42.992629 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" event={"ID":"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee","Type":"ContainerStarted","Data":"46f36f5d6a2d3a3118bd884a1c524af3b258f8236d8a1895c61ee8c41094272a"} Jul 14 16:35:46.008334 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:46.008298 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" event={"ID":"18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee","Type":"ContainerStarted","Data":"1d846d47ddb67bbd4c2ff35d51f5cc6397ad2540fdb3b8de297e566578fedb3c"} Jul 14 16:35:46.028073 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:46.028027 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f68dcd7b8-kf6dw" podStartSLOduration=1.699164094 podStartE2EDuration="5.028013281s" totalImagesPullingTime="3.328849187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:46.027269759 +0000 UTC m=+336.888659056" watchObservedRunningTime="2026-07-14 16:35:46.028013281 +0000 UTC m=+336.889402563" Jul 14 16:35:48.976168 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:48.976135 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7889f65889-hxvfj" Jul 14 16:35:50.338178 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.338146 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj"] Jul 14 16:35:50.341630 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.341614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.362501 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.362481 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 16:35:50.362597 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.362536 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gt7vh\"" Jul 14 16:35:50.453965 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.453938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.454085 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.453979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.454085 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.454009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c26db5-9ea1-4693-a70e-cde75d866545-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.454085 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.454030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.454085 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.454071 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68c26db5-9ea1-4693-a70e-cde75d866545-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.454233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.454092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68c26db5-9ea1-4693-a70e-cde75d866545-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.454233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.454113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.454233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.454135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.454233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.454200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hnpx\" (UniqueName: \"kubernetes.io/projected/68c26db5-9ea1-4693-a70e-cde75d866545-kube-api-access-9hnpx\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.532295 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.532271 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj"] Jul 14 16:35:50.554821 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.554796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.554943 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.554829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c26db5-9ea1-4693-a70e-cde75d866545-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.554943 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.554850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.554943 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.554901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68c26db5-9ea1-4693-a70e-cde75d866545-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.554943 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.554921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68c26db5-9ea1-4693-a70e-cde75d866545-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.555189 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.554945 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.555270 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.555247 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.555324 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.554975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.555372 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.555352 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.555451 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.555374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hnpx\" (UniqueName: \"kubernetes.io/projected/68c26db5-9ea1-4693-a70e-cde75d866545-kube-api-access-9hnpx\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.555451 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.555441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.555552 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.555458 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.555745 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.555716 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.555838 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.555763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68c26db5-9ea1-4693-a70e-cde75d866545-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.557280 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.557256 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68c26db5-9ea1-4693-a70e-cde75d866545-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.557375 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.557358 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68c26db5-9ea1-4693-a70e-cde75d866545-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.570338 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.570316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hnpx\" (UniqueName: \"kubernetes.io/projected/68c26db5-9ea1-4693-a70e-cde75d866545-kube-api-access-9hnpx\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.589675 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.589626 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c26db5-9ea1-4693-a70e-cde75d866545-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fl5fj\" (UID: \"68c26db5-9ea1-4693-a70e-cde75d866545\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.650909 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.650887 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:50.810966 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:50.810938 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj"] Jul 14 16:35:50.816000 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:35:50.815963 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c26db5_9ea1_4693_a70e_cde75d866545.slice/crio-5704ab51ae88bfe5c920fec2e03a51f7ed0db0b5c0a69b2c3ecd3e7c122aaf04 WatchSource:0}: Error finding container 5704ab51ae88bfe5c920fec2e03a51f7ed0db0b5c0a69b2c3ecd3e7c122aaf04: Status 404 returned error can't find the container with id 5704ab51ae88bfe5c920fec2e03a51f7ed0db0b5c0a69b2c3ecd3e7c122aaf04 Jul 14 16:35:51.031548 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:51.031510 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" event={"ID":"68c26db5-9ea1-4693-a70e-cde75d866545","Type":"ContainerStarted","Data":"5704ab51ae88bfe5c920fec2e03a51f7ed0db0b5c0a69b2c3ecd3e7c122aaf04"} Jul 14 16:35:53.568569 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:53.568525 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:35:53.568832 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:53.568616 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:35:53.568832 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:53.568649 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:35:54.048717 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:54.048678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" event={"ID":"68c26db5-9ea1-4693-a70e-cde75d866545","Type":"ContainerStarted","Data":"2cabd0c2fde62173577dfc5d6a7b6878cb6b4d9fae37b6951c28a2a2a32d90a5"} Jul 14 16:35:54.071379 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:54.071330 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" podStartSLOduration=1.321074598 podStartE2EDuration="4.071315746s" totalImagesPullingTime="2.750241148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:54.070445956 +0000 UTC m=+344.931835238" watchObservedRunningTime="2026-07-14 16:35:54.071315746 +0000 UTC m=+344.932705029" Jul 14 16:35:54.651082 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:54.651050 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:54.655496 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:54.655473 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:55.053107 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:55.053023 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:35:55.053883 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:35:55.053863 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fl5fj" Jul 14 16:36:44.861444 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:44.861413 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78dd79866f-bbpvc"] Jul 14 16:36:44.864703 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:44.864684 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:44.888364 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:44.888336 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78dd79866f-bbpvc"] Jul 14 16:36:44.899727 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:44.899706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-oauth-serving-cert\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:44.899833 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:44.899738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/472a8db5-32cd-4f3a-88e3-87b136c05535-console-oauth-config\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:44.899833 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:44.899756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-console-config\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:44.899833 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:44.899808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-service-ca\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:44.899833 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:44.899831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/472a8db5-32cd-4f3a-88e3-87b136c05535-console-serving-cert\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:44.899986 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:44.899863 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-trusted-ca-bundle\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:44.899986 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:44.899929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbz8l\" (UniqueName: \"kubernetes.io/projected/472a8db5-32cd-4f3a-88e3-87b136c05535-kube-api-access-wbz8l\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.000795 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.000761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-oauth-serving-cert\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.000923 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.000802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/472a8db5-32cd-4f3a-88e3-87b136c05535-console-oauth-config\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.000923 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.000817 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-console-config\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.000923 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.000869 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-service-ca\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.000923 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.000909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/472a8db5-32cd-4f3a-88e3-87b136c05535-console-serving-cert\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.001085 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.000947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-trusted-ca-bundle\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.001085 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.000986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbz8l\" (UniqueName: \"kubernetes.io/projected/472a8db5-32cd-4f3a-88e3-87b136c05535-kube-api-access-wbz8l\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.001639 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.001617 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-oauth-serving-cert\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.001745 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.001658 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-service-ca\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.001745 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.001619 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-console-config\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.001951 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.001809 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472a8db5-32cd-4f3a-88e3-87b136c05535-trusted-ca-bundle\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.003337 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.003314 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/472a8db5-32cd-4f3a-88e3-87b136c05535-console-oauth-config\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.003480 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.003462 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/472a8db5-32cd-4f3a-88e3-87b136c05535-console-serving-cert\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.013647 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.013628 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbz8l\" (UniqueName: \"kubernetes.io/projected/472a8db5-32cd-4f3a-88e3-87b136c05535-kube-api-access-wbz8l\") pod \"console-78dd79866f-bbpvc\" (UID: \"472a8db5-32cd-4f3a-88e3-87b136c05535\") " pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.173899 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.173860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:45.317048 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:45.317023 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78dd79866f-bbpvc"] Jul 14 16:36:45.319122 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:36:45.319094 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472a8db5_32cd_4f3a_88e3_87b136c05535.slice/crio-4e7928440ff83a08c18426b6893f7ae3962ca043d3575443985d1137d94d03a2 WatchSource:0}: Error finding container 4e7928440ff83a08c18426b6893f7ae3962ca043d3575443985d1137d94d03a2: Status 404 returned error can't find the container with id 4e7928440ff83a08c18426b6893f7ae3962ca043d3575443985d1137d94d03a2 Jul 14 16:36:46.297836 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:46.297797 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dd79866f-bbpvc" event={"ID":"472a8db5-32cd-4f3a-88e3-87b136c05535","Type":"ContainerStarted","Data":"6eaabb784dd8deede9c410070ec6eeff5c416bc997980e9866a1a8b7dba4cdfb"} Jul 14 16:36:46.298191 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:46.297853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dd79866f-bbpvc" event={"ID":"472a8db5-32cd-4f3a-88e3-87b136c05535","Type":"ContainerStarted","Data":"4e7928440ff83a08c18426b6893f7ae3962ca043d3575443985d1137d94d03a2"} Jul 14 16:36:46.320782 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:46.320738 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78dd79866f-bbpvc" podStartSLOduration=2.320724952 podStartE2EDuration="2.320724952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:36:46.319081517 +0000 UTC m=+397.180470801" watchObservedRunningTime="2026-07-14 16:36:46.320724952 +0000 UTC m=+397.182114235" Jul 14 16:36:51.234237 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.234200 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb"] Jul 14 16:36:51.237901 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.237885 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.240776 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.240755 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 16:36:51.240901 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.240836 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 16:36:51.241691 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.241676 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8xkxt\"" Jul 14 16:36:51.246944 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.246918 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb"] Jul 14 16:36:51.354350 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.354318 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.354350 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.354352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7mcp\" (UniqueName: \"kubernetes.io/projected/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-kube-api-access-f7mcp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.354574 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.354452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.455610 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.455575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.455610 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.455613 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7mcp\" (UniqueName: \"kubernetes.io/projected/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-kube-api-access-f7mcp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.455787 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.455676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.456065 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.456042 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.456105 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.456063 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.467481 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.467457 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7mcp\" (UniqueName: \"kubernetes.io/projected/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-kube-api-access-f7mcp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.548475 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.548368 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:51.680356 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:51.680324 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb"] Jul 14 16:36:51.683305 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:36:51.683278 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f59e3f_1e62_42d1_9e0d_94b99c24fdcd.slice/crio-6b792b09f6d4d53a82ace8c54b89a5e294995e35eac62bbd0be82c5e8cbb7878 WatchSource:0}: Error finding container 6b792b09f6d4d53a82ace8c54b89a5e294995e35eac62bbd0be82c5e8cbb7878: Status 404 returned error can't find the container with id 6b792b09f6d4d53a82ace8c54b89a5e294995e35eac62bbd0be82c5e8cbb7878 Jul 14 16:36:52.022102 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.022066 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2"] Jul 14 16:36:52.025441 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.025424 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.036301 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.036278 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2"] Jul 14 16:36:52.061662 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.061637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.061777 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.061700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.061817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.061776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mrql\" (UniqueName: \"kubernetes.io/projected/f085c22a-2ae1-40bc-b077-6de40d58e69d-kube-api-access-8mrql\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.162603 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.162578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mrql\" (UniqueName: \"kubernetes.io/projected/f085c22a-2ae1-40bc-b077-6de40d58e69d-kube-api-access-8mrql\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.162727 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.162620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.162727 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.162670 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.163024 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.163008 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.163059 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.163043 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.173102 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.173081 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mrql\" (UniqueName: \"kubernetes.io/projected/f085c22a-2ae1-40bc-b077-6de40d58e69d-kube-api-access-8mrql\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.326655 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.326586 2564 generic.go:356] "Generic (PLEG): container finished" podID="62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" containerID="eeea5af0fd35aa1e503cf4246163710fda44d9987353006ead7e047127bd77b8" exitCode=0 Jul 14 16:36:52.326990 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.326657 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" event={"ID":"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd","Type":"ContainerDied","Data":"eeea5af0fd35aa1e503cf4246163710fda44d9987353006ead7e047127bd77b8"} Jul 14 16:36:52.326990 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.326705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" event={"ID":"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd","Type":"ContainerStarted","Data":"6b792b09f6d4d53a82ace8c54b89a5e294995e35eac62bbd0be82c5e8cbb7878"} Jul 14 16:36:52.334834 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.334812 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:52.468249 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.467655 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2"] Jul 14 16:36:52.470629 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:36:52.470605 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf085c22a_2ae1_40bc_b077_6de40d58e69d.slice/crio-7fc3918300dbf55c40dc393a76242c507cd6b28fb2700985434657dabe1ce220 WatchSource:0}: Error finding container 7fc3918300dbf55c40dc393a76242c507cd6b28fb2700985434657dabe1ce220: Status 404 returned error can't find the container with id 7fc3918300dbf55c40dc393a76242c507cd6b28fb2700985434657dabe1ce220 Jul 14 16:36:52.814437 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.814399 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc"] Jul 14 16:36:52.818049 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.818027 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:52.827890 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.827867 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc"] Jul 14 16:36:52.868733 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.868679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8bdd\" (UniqueName: \"kubernetes.io/projected/312befbc-3ee5-4ed5-b33b-6366adc5fce8-kube-api-access-x8bdd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:52.868826 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.868764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:52.868826 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.868791 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:52.970099 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.970064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:52.970256 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.970110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:52.970256 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.970152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8bdd\" (UniqueName: \"kubernetes.io/projected/312befbc-3ee5-4ed5-b33b-6366adc5fce8-kube-api-access-x8bdd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:52.970594 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.970572 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:52.970594 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.970582 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:52.979338 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:52.979315 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8bdd\" (UniqueName: \"kubernetes.io/projected/312befbc-3ee5-4ed5-b33b-6366adc5fce8-kube-api-access-x8bdd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:53.127495 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.127444 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:53.254248 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.254218 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc"] Jul 14 16:36:53.255962 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:36:53.255938 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod312befbc_3ee5_4ed5_b33b_6366adc5fce8.slice/crio-71768a7259e91fbb9d366068f0fd3f57b1364905fe985d908a75accc259c2298 WatchSource:0}: Error finding container 71768a7259e91fbb9d366068f0fd3f57b1364905fe985d908a75accc259c2298: Status 404 returned error can't find the container with id 71768a7259e91fbb9d366068f0fd3f57b1364905fe985d908a75accc259c2298 Jul 14 16:36:53.333501 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.333475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" event={"ID":"312befbc-3ee5-4ed5-b33b-6366adc5fce8","Type":"ContainerStarted","Data":"3f841d2f95ed7ff87e5125df52fd704468abd7e21ac6df59591c4c44aa32e05b"} Jul 14 16:36:53.333845 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.333528 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" event={"ID":"312befbc-3ee5-4ed5-b33b-6366adc5fce8","Type":"ContainerStarted","Data":"71768a7259e91fbb9d366068f0fd3f57b1364905fe985d908a75accc259c2298"} Jul 14 16:36:53.334963 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.334942 2564 generic.go:356] "Generic (PLEG): container finished" podID="f085c22a-2ae1-40bc-b077-6de40d58e69d" containerID="e7abca67c8277b14a926fd43979c4568ef57a5751299be10b91594fe8c0e15db" exitCode=0 Jul 14 16:36:53.335067 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.335023 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" event={"ID":"f085c22a-2ae1-40bc-b077-6de40d58e69d","Type":"ContainerDied","Data":"e7abca67c8277b14a926fd43979c4568ef57a5751299be10b91594fe8c0e15db"} Jul 14 16:36:53.335067 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.335063 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" event={"ID":"f085c22a-2ae1-40bc-b077-6de40d58e69d","Type":"ContainerStarted","Data":"7fc3918300dbf55c40dc393a76242c507cd6b28fb2700985434657dabe1ce220"} Jul 14 16:36:53.336965 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.336942 2564 generic.go:356] "Generic (PLEG): container finished" podID="62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" containerID="296792a9ac71830ec82b375ea48b1fc240f980818b44abf06969ed3148fca802" exitCode=0 Jul 14 16:36:53.337071 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.336976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" event={"ID":"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd","Type":"ContainerDied","Data":"296792a9ac71830ec82b375ea48b1fc240f980818b44abf06969ed3148fca802"} Jul 14 16:36:53.610697 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.610668 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r"] Jul 14 16:36:53.614105 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.614087 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:53.623352 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.623332 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r"] Jul 14 16:36:53.676645 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.676575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:53.676645 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.676632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qbzw\" (UniqueName: \"kubernetes.io/projected/3a2dd81b-018a-4013-8223-31950c8981ac-kube-api-access-8qbzw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:53.676801 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.676686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:53.777675 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.777642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qbzw\" (UniqueName: \"kubernetes.io/projected/3a2dd81b-018a-4013-8223-31950c8981ac-kube-api-access-8qbzw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:53.777811 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.777685 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:53.777811 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.777768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:53.778134 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.778114 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:53.778134 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.778128 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:53.787818 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.787794 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qbzw\" (UniqueName: \"kubernetes.io/projected/3a2dd81b-018a-4013-8223-31950c8981ac-kube-api-access-8qbzw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:53.923634 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:53.923591 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:54.053642 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:54.053612 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r"] Jul 14 16:36:54.054902 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:36:54.054878 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2dd81b_018a_4013_8223_31950c8981ac.slice/crio-b598ff0455a182ed1a66048f05347d4b3f193836b6566b583e33e75da32d1c8b WatchSource:0}: Error finding container b598ff0455a182ed1a66048f05347d4b3f193836b6566b583e33e75da32d1c8b: Status 404 returned error can't find the container with id b598ff0455a182ed1a66048f05347d4b3f193836b6566b583e33e75da32d1c8b Jul 14 16:36:54.343509 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:54.343421 2564 generic.go:356] "Generic (PLEG): container finished" podID="62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" containerID="cfa55a8b7f09ec418af2618bfdf42032ee22660a82f78765c8854c1446e7eaa9" exitCode=0 Jul 14 16:36:54.343509 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:54.343495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" event={"ID":"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd","Type":"ContainerDied","Data":"cfa55a8b7f09ec418af2618bfdf42032ee22660a82f78765c8854c1446e7eaa9"} Jul 14 16:36:54.344939 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:54.344917 2564 generic.go:356] "Generic (PLEG): container finished" podID="3a2dd81b-018a-4013-8223-31950c8981ac" containerID="0d3739aecf46c628da332add43ebbdfc0f5c2141140a7635a94cec181b471c52" exitCode=0 Jul 14 16:36:54.345034 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:54.344998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" event={"ID":"3a2dd81b-018a-4013-8223-31950c8981ac","Type":"ContainerDied","Data":"0d3739aecf46c628da332add43ebbdfc0f5c2141140a7635a94cec181b471c52"} Jul 14 16:36:54.345087 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:54.345042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" event={"ID":"3a2dd81b-018a-4013-8223-31950c8981ac","Type":"ContainerStarted","Data":"b598ff0455a182ed1a66048f05347d4b3f193836b6566b583e33e75da32d1c8b"} Jul 14 16:36:54.346421 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:54.346399 2564 generic.go:356] "Generic (PLEG): container finished" podID="312befbc-3ee5-4ed5-b33b-6366adc5fce8" containerID="3f841d2f95ed7ff87e5125df52fd704468abd7e21ac6df59591c4c44aa32e05b" exitCode=0 Jul 14 16:36:54.346499 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:54.346419 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" event={"ID":"312befbc-3ee5-4ed5-b33b-6366adc5fce8","Type":"ContainerDied","Data":"3f841d2f95ed7ff87e5125df52fd704468abd7e21ac6df59591c4c44aa32e05b"} Jul 14 16:36:55.174096 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.174051 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:55.174265 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.174162 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:55.179366 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.179342 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:55.353485 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.353457 2564 generic.go:356] "Generic (PLEG): container finished" podID="3a2dd81b-018a-4013-8223-31950c8981ac" containerID="64111a2df63b6319c99eb9bee0e96849fe4c6113c400a27f0a2fcec4c8370ec2" exitCode=0 Jul 14 16:36:55.353820 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.353531 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" event={"ID":"3a2dd81b-018a-4013-8223-31950c8981ac","Type":"ContainerDied","Data":"64111a2df63b6319c99eb9bee0e96849fe4c6113c400a27f0a2fcec4c8370ec2"} Jul 14 16:36:55.355404 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.355370 2564 generic.go:356] "Generic (PLEG): container finished" podID="312befbc-3ee5-4ed5-b33b-6366adc5fce8" containerID="1ea89ffacd3a593124fff9a197d02b504efa9b19c95388733f540a21b3d2e3c6" exitCode=0 Jul 14 16:36:55.355479 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.355417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" event={"ID":"312befbc-3ee5-4ed5-b33b-6366adc5fce8","Type":"ContainerDied","Data":"1ea89ffacd3a593124fff9a197d02b504efa9b19c95388733f540a21b3d2e3c6"} Jul 14 16:36:55.357329 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.357308 2564 generic.go:356] "Generic (PLEG): container finished" podID="f085c22a-2ae1-40bc-b077-6de40d58e69d" containerID="19ae5a4feb192405101d7caab19f078c885cb267788c4130c258d307f05cc0dd" exitCode=0 Jul 14 16:36:55.357445 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.357369 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" event={"ID":"f085c22a-2ae1-40bc-b077-6de40d58e69d","Type":"ContainerDied","Data":"19ae5a4feb192405101d7caab19f078c885cb267788c4130c258d307f05cc0dd"} Jul 14 16:36:55.364884 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.363132 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78dd79866f-bbpvc" Jul 14 16:36:55.449226 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.449200 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55786f46bb-xzt72"] Jul 14 16:36:55.511847 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.511614 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:55.594068 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.594038 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-util\") pod \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " Jul 14 16:36:55.594194 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.594094 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-bundle\") pod \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " Jul 14 16:36:55.594194 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.594135 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7mcp\" (UniqueName: \"kubernetes.io/projected/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-kube-api-access-f7mcp\") pod \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\" (UID: \"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd\") " Jul 14 16:36:55.594693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.594652 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-bundle" (OuterVolumeSpecName: "bundle") pod "62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" (UID: "62f59e3f-1e62-42d1-9e0d-94b99c24fdcd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:36:55.594922 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.594897 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:55.596807 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.596783 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-kube-api-access-f7mcp" (OuterVolumeSpecName: "kube-api-access-f7mcp") pod "62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" (UID: "62f59e3f-1e62-42d1-9e0d-94b99c24fdcd"). InnerVolumeSpecName "kube-api-access-f7mcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:36:55.599949 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.599929 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-util" (OuterVolumeSpecName: "util") pod "62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" (UID: "62f59e3f-1e62-42d1-9e0d-94b99c24fdcd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:36:55.695773 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.695723 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-util\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:55.695773 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:55.695743 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7mcp\" (UniqueName: \"kubernetes.io/projected/62f59e3f-1e62-42d1-9e0d-94b99c24fdcd-kube-api-access-f7mcp\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:56.364195 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:56.364168 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" Jul 14 16:36:56.364632 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:56.364169 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb" event={"ID":"62f59e3f-1e62-42d1-9e0d-94b99c24fdcd","Type":"ContainerDied","Data":"6b792b09f6d4d53a82ace8c54b89a5e294995e35eac62bbd0be82c5e8cbb7878"} Jul 14 16:36:56.364632 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:56.364284 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b792b09f6d4d53a82ace8c54b89a5e294995e35eac62bbd0be82c5e8cbb7878" Jul 14 16:36:56.366236 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:56.366209 2564 generic.go:356] "Generic (PLEG): container finished" podID="3a2dd81b-018a-4013-8223-31950c8981ac" containerID="b026bfce6628a5e23ad5cf6ee6f708c47272191c59815ef2c9c2c7fcb8644795" exitCode=0 Jul 14 16:36:56.366336 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:56.366281 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" event={"ID":"3a2dd81b-018a-4013-8223-31950c8981ac","Type":"ContainerDied","Data":"b026bfce6628a5e23ad5cf6ee6f708c47272191c59815ef2c9c2c7fcb8644795"} Jul 14 16:36:56.368257 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:56.368237 2564 generic.go:356] "Generic (PLEG): container finished" podID="312befbc-3ee5-4ed5-b33b-6366adc5fce8" containerID="0af4133de6907bc7a444d70166a900ae76861c437b603c583dd8f040859942ce" exitCode=0 Jul 14 16:36:56.368340 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:56.368300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" event={"ID":"312befbc-3ee5-4ed5-b33b-6366adc5fce8","Type":"ContainerDied","Data":"0af4133de6907bc7a444d70166a900ae76861c437b603c583dd8f040859942ce"} Jul 14 16:36:56.370270 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:56.370247 2564 generic.go:356] "Generic (PLEG): container finished" podID="f085c22a-2ae1-40bc-b077-6de40d58e69d" containerID="36257846b4d07cf3141ed4379c5bb8d11736015af754b19bee7b8ba5bce0deef" exitCode=0 Jul 14 16:36:56.370350 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:56.370275 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" event={"ID":"f085c22a-2ae1-40bc-b077-6de40d58e69d","Type":"ContainerDied","Data":"36257846b4d07cf3141ed4379c5bb8d11736015af754b19bee7b8ba5bce0deef"} Jul 14 16:36:57.534112 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.534089 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:57.577636 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.577615 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:36:57.580670 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.580652 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:57.610226 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.610200 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-util\") pod \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " Jul 14 16:36:57.610328 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.610246 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8bdd\" (UniqueName: \"kubernetes.io/projected/312befbc-3ee5-4ed5-b33b-6366adc5fce8-kube-api-access-x8bdd\") pod \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " Jul 14 16:36:57.610328 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.610289 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-bundle\") pod \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\" (UID: \"312befbc-3ee5-4ed5-b33b-6366adc5fce8\") " Jul 14 16:36:57.610847 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.610821 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-bundle" (OuterVolumeSpecName: "bundle") pod "312befbc-3ee5-4ed5-b33b-6366adc5fce8" (UID: "312befbc-3ee5-4ed5-b33b-6366adc5fce8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:36:57.612312 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.612286 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/312befbc-3ee5-4ed5-b33b-6366adc5fce8-kube-api-access-x8bdd" (OuterVolumeSpecName: "kube-api-access-x8bdd") pod "312befbc-3ee5-4ed5-b33b-6366adc5fce8" (UID: "312befbc-3ee5-4ed5-b33b-6366adc5fce8"). InnerVolumeSpecName "kube-api-access-x8bdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:36:57.618107 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.617988 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-util" (OuterVolumeSpecName: "util") pod "312befbc-3ee5-4ed5-b33b-6366adc5fce8" (UID: "312befbc-3ee5-4ed5-b33b-6366adc5fce8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:36:57.711648 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.711619 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-util\") pod \"f085c22a-2ae1-40bc-b077-6de40d58e69d\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " Jul 14 16:36:57.711807 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.711679 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-util\") pod \"3a2dd81b-018a-4013-8223-31950c8981ac\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " Jul 14 16:36:57.711807 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.711729 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qbzw\" (UniqueName: \"kubernetes.io/projected/3a2dd81b-018a-4013-8223-31950c8981ac-kube-api-access-8qbzw\") pod \"3a2dd81b-018a-4013-8223-31950c8981ac\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " Jul 14 16:36:57.711807 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.711765 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-bundle\") pod \"3a2dd81b-018a-4013-8223-31950c8981ac\" (UID: \"3a2dd81b-018a-4013-8223-31950c8981ac\") " Jul 14 16:36:57.711807 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.711784 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-bundle\") pod \"f085c22a-2ae1-40bc-b077-6de40d58e69d\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " Jul 14 16:36:57.712081 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.711815 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mrql\" (UniqueName: \"kubernetes.io/projected/f085c22a-2ae1-40bc-b077-6de40d58e69d-kube-api-access-8mrql\") pod \"f085c22a-2ae1-40bc-b077-6de40d58e69d\" (UID: \"f085c22a-2ae1-40bc-b077-6de40d58e69d\") " Jul 14 16:36:57.712144 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.712099 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-util\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:57.712144 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.712118 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8bdd\" (UniqueName: \"kubernetes.io/projected/312befbc-3ee5-4ed5-b33b-6366adc5fce8-kube-api-access-x8bdd\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:57.712144 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.712134 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/312befbc-3ee5-4ed5-b33b-6366adc5fce8-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:57.712509 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.712479 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-bundle" (OuterVolumeSpecName: "bundle") pod "f085c22a-2ae1-40bc-b077-6de40d58e69d" (UID: "f085c22a-2ae1-40bc-b077-6de40d58e69d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:36:57.712776 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.712746 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-bundle" (OuterVolumeSpecName: "bundle") pod "3a2dd81b-018a-4013-8223-31950c8981ac" (UID: "3a2dd81b-018a-4013-8223-31950c8981ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:36:57.713997 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.713971 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a2dd81b-018a-4013-8223-31950c8981ac-kube-api-access-8qbzw" (OuterVolumeSpecName: "kube-api-access-8qbzw") pod "3a2dd81b-018a-4013-8223-31950c8981ac" (UID: "3a2dd81b-018a-4013-8223-31950c8981ac"). InnerVolumeSpecName "kube-api-access-8qbzw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:36:57.714088 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.714007 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f085c22a-2ae1-40bc-b077-6de40d58e69d-kube-api-access-8mrql" (OuterVolumeSpecName: "kube-api-access-8mrql") pod "f085c22a-2ae1-40bc-b077-6de40d58e69d" (UID: "f085c22a-2ae1-40bc-b077-6de40d58e69d"). InnerVolumeSpecName "kube-api-access-8mrql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:36:57.721052 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.721025 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-util" (OuterVolumeSpecName: "util") pod "3a2dd81b-018a-4013-8223-31950c8981ac" (UID: "3a2dd81b-018a-4013-8223-31950c8981ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:36:57.721154 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.721138 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-util" (OuterVolumeSpecName: "util") pod "f085c22a-2ae1-40bc-b077-6de40d58e69d" (UID: "f085c22a-2ae1-40bc-b077-6de40d58e69d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:36:57.812534 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.812508 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qbzw\" (UniqueName: \"kubernetes.io/projected/3a2dd81b-018a-4013-8223-31950c8981ac-kube-api-access-8qbzw\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:57.812534 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.812531 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:57.812667 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.812541 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:57.812667 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.812549 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mrql\" (UniqueName: \"kubernetes.io/projected/f085c22a-2ae1-40bc-b077-6de40d58e69d-kube-api-access-8mrql\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:57.812667 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.812557 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f085c22a-2ae1-40bc-b077-6de40d58e69d-util\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:57.812667 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:57.812566 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a2dd81b-018a-4013-8223-31950c8981ac-util\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:36:58.381639 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:58.381611 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" Jul 14 16:36:58.381813 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:58.381610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r" event={"ID":"3a2dd81b-018a-4013-8223-31950c8981ac","Type":"ContainerDied","Data":"b598ff0455a182ed1a66048f05347d4b3f193836b6566b583e33e75da32d1c8b"} Jul 14 16:36:58.381813 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:58.381769 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b598ff0455a182ed1a66048f05347d4b3f193836b6566b583e33e75da32d1c8b" Jul 14 16:36:58.383546 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:58.383519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" event={"ID":"312befbc-3ee5-4ed5-b33b-6366adc5fce8","Type":"ContainerDied","Data":"71768a7259e91fbb9d366068f0fd3f57b1364905fe985d908a75accc259c2298"} Jul 14 16:36:58.383667 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:58.383564 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71768a7259e91fbb9d366068f0fd3f57b1364905fe985d908a75accc259c2298" Jul 14 16:36:58.383667 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:58.383527 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc" Jul 14 16:36:58.385352 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:58.385330 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" event={"ID":"f085c22a-2ae1-40bc-b077-6de40d58e69d","Type":"ContainerDied","Data":"7fc3918300dbf55c40dc393a76242c507cd6b28fb2700985434657dabe1ce220"} Jul 14 16:36:58.385470 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:58.385363 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fc3918300dbf55c40dc393a76242c507cd6b28fb2700985434657dabe1ce220" Jul 14 16:36:58.385470 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:36:58.385416 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2" Jul 14 16:37:20.479406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.479334 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55786f46bb-xzt72" podUID="d6116b29-0825-47b1-a096-1a861630665a" containerName="console" containerID="cri-o://e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb" gracePeriod=15 Jul 14 16:37:20.723843 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.723820 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:37:20.896880 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.896847 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8nsq\" (UniqueName: \"kubernetes.io/projected/d6116b29-0825-47b1-a096-1a861630665a-kube-api-access-p8nsq\") pod \"d6116b29-0825-47b1-a096-1a861630665a\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " Jul 14 16:37:20.897060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.896931 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-oauth-config\") pod \"d6116b29-0825-47b1-a096-1a861630665a\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " Jul 14 16:37:20.897060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.896957 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-serving-cert\") pod \"d6116b29-0825-47b1-a096-1a861630665a\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " Jul 14 16:37:20.897060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.897010 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-trusted-ca-bundle\") pod \"d6116b29-0825-47b1-a096-1a861630665a\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " Jul 14 16:37:20.897233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.897128 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-service-ca\") pod \"d6116b29-0825-47b1-a096-1a861630665a\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " Jul 14 16:37:20.897233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.897178 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-console-config\") pod \"d6116b29-0825-47b1-a096-1a861630665a\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " Jul 14 16:37:20.897335 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.897237 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-oauth-serving-cert\") pod \"d6116b29-0825-47b1-a096-1a861630665a\" (UID: \"d6116b29-0825-47b1-a096-1a861630665a\") " Jul 14 16:37:20.897505 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.897479 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d6116b29-0825-47b1-a096-1a861630665a" (UID: "d6116b29-0825-47b1-a096-1a861630665a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:37:20.897647 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.897506 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-service-ca" (OuterVolumeSpecName: "service-ca") pod "d6116b29-0825-47b1-a096-1a861630665a" (UID: "d6116b29-0825-47b1-a096-1a861630665a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:37:20.897647 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.897555 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-console-config" (OuterVolumeSpecName: "console-config") pod "d6116b29-0825-47b1-a096-1a861630665a" (UID: "d6116b29-0825-47b1-a096-1a861630665a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:37:20.897647 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.897572 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-trusted-ca-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:37:20.897647 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.897590 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-service-ca\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:37:20.897862 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.897799 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d6116b29-0825-47b1-a096-1a861630665a" (UID: "d6116b29-0825-47b1-a096-1a861630665a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:37:20.899203 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.899184 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d6116b29-0825-47b1-a096-1a861630665a" (UID: "d6116b29-0825-47b1-a096-1a861630665a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:37:20.899531 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.899503 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d6116b29-0825-47b1-a096-1a861630665a" (UID: "d6116b29-0825-47b1-a096-1a861630665a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:37:20.899600 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.899511 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6116b29-0825-47b1-a096-1a861630665a-kube-api-access-p8nsq" (OuterVolumeSpecName: "kube-api-access-p8nsq") pod "d6116b29-0825-47b1-a096-1a861630665a" (UID: "d6116b29-0825-47b1-a096-1a861630665a"). InnerVolumeSpecName "kube-api-access-p8nsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:37:20.998087 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.998063 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-console-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:37:20.998087 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.998087 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6116b29-0825-47b1-a096-1a861630665a-oauth-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:37:20.998247 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.998098 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8nsq\" (UniqueName: \"kubernetes.io/projected/d6116b29-0825-47b1-a096-1a861630665a-kube-api-access-p8nsq\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:37:20.998247 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.998107 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-oauth-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:37:20.998247 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:20.998117 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6116b29-0825-47b1-a096-1a861630665a-console-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:37:21.496051 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:21.496016 2564 generic.go:356] "Generic (PLEG): container finished" podID="d6116b29-0825-47b1-a096-1a861630665a" containerID="e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb" exitCode=0 Jul 14 16:37:21.496490 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:21.496067 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55786f46bb-xzt72" Jul 14 16:37:21.496490 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:21.496068 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55786f46bb-xzt72" event={"ID":"d6116b29-0825-47b1-a096-1a861630665a","Type":"ContainerDied","Data":"e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb"} Jul 14 16:37:21.496490 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:21.496110 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55786f46bb-xzt72" event={"ID":"d6116b29-0825-47b1-a096-1a861630665a","Type":"ContainerDied","Data":"38d58cb1e5613a9dacfc49fb568d928fea8fdcb9b5c428a395815518ae18deee"} Jul 14 16:37:21.496490 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:21.496137 2564 scope.go:117] "RemoveContainer" containerID="e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb" Jul 14 16:37:21.505089 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:21.505072 2564 scope.go:117] "RemoveContainer" containerID="e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb" Jul 14 16:37:21.505337 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:37:21.505318 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb\": container with ID starting with e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb not found: ID does not exist" containerID="e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb" Jul 14 16:37:21.505405 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:21.505345 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb"} err="failed to get container status \"e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb\": rpc error: code = NotFound desc = could not find container \"e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb\": container with ID starting with e3ec6fea915fa2d5d563dfe06e1ee360c0a594383deb1b2b11f71081d60402cb not found: ID does not exist" Jul 14 16:37:21.518945 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:21.518917 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55786f46bb-xzt72"] Jul 14 16:37:21.523570 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:21.523548 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55786f46bb-xzt72"] Jul 14 16:37:22.218885 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.218853 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm"] Jul 14 16:37:22.219194 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219182 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2dd81b-018a-4013-8223-31950c8981ac" containerName="util" Jul 14 16:37:22.219236 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219196 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2dd81b-018a-4013-8223-31950c8981ac" containerName="util" Jul 14 16:37:22.219236 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219207 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f085c22a-2ae1-40bc-b077-6de40d58e69d" containerName="util" Jul 14 16:37:22.219236 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219214 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f085c22a-2ae1-40bc-b077-6de40d58e69d" containerName="util" Jul 14 16:37:22.219236 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219226 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2dd81b-018a-4013-8223-31950c8981ac" containerName="extract" Jul 14 16:37:22.219236 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219232 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2dd81b-018a-4013-8223-31950c8981ac" containerName="extract" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219242 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="312befbc-3ee5-4ed5-b33b-6366adc5fce8" containerName="pull" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219247 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="312befbc-3ee5-4ed5-b33b-6366adc5fce8" containerName="pull" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219257 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" containerName="util" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219264 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" containerName="util" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219270 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" containerName="extract" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219275 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" containerName="extract" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219282 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6116b29-0825-47b1-a096-1a861630665a" containerName="console" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219288 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6116b29-0825-47b1-a096-1a861630665a" containerName="console" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219297 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f085c22a-2ae1-40bc-b077-6de40d58e69d" containerName="pull" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219304 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f085c22a-2ae1-40bc-b077-6de40d58e69d" containerName="pull" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219310 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f085c22a-2ae1-40bc-b077-6de40d58e69d" containerName="extract" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219315 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f085c22a-2ae1-40bc-b077-6de40d58e69d" containerName="extract" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219320 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="312befbc-3ee5-4ed5-b33b-6366adc5fce8" containerName="extract" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219325 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="312befbc-3ee5-4ed5-b33b-6366adc5fce8" containerName="extract" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219333 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="312befbc-3ee5-4ed5-b33b-6366adc5fce8" containerName="util" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219338 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="312befbc-3ee5-4ed5-b33b-6366adc5fce8" containerName="util" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219344 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" containerName="pull" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219349 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" containerName="pull" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219356 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2dd81b-018a-4013-8223-31950c8981ac" containerName="pull" Jul 14 16:37:22.219406 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219362 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2dd81b-018a-4013-8223-31950c8981ac" containerName="pull" Jul 14 16:37:22.220006 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219433 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f085c22a-2ae1-40bc-b077-6de40d58e69d" containerName="extract" Jul 14 16:37:22.220006 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219443 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6116b29-0825-47b1-a096-1a861630665a" containerName="console" Jul 14 16:37:22.220006 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219453 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="312befbc-3ee5-4ed5-b33b-6366adc5fce8" containerName="extract" Jul 14 16:37:22.220006 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219462 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2dd81b-018a-4013-8223-31950c8981ac" containerName="extract" Jul 14 16:37:22.220006 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.219469 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f59e3f-1e62-42d1-9e0d-94b99c24fdcd" containerName="extract" Jul 14 16:37:22.223807 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.223790 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.226578 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.226548 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 14 16:37:22.226713 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.226690 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 14 16:37:22.226790 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.226698 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 16:37:22.227594 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.227576 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 16:37:22.227685 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.227584 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8xkxt\"" Jul 14 16:37:22.233148 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.233126 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm"] Jul 14 16:37:22.407150 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.407121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98wch\" (UniqueName: \"kubernetes.io/projected/6cc8fd93-16ca-4164-8bcb-370c39906b09-kube-api-access-98wch\") pod \"kuadrant-console-plugin-66b5774985-6fnkm\" (UID: \"6cc8fd93-16ca-4164-8bcb-370c39906b09\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.407306 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.407172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cc8fd93-16ca-4164-8bcb-370c39906b09-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6fnkm\" (UID: \"6cc8fd93-16ca-4164-8bcb-370c39906b09\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.407306 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.407261 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cc8fd93-16ca-4164-8bcb-370c39906b09-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6fnkm\" (UID: \"6cc8fd93-16ca-4164-8bcb-370c39906b09\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.487762 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.487697 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6116b29-0825-47b1-a096-1a861630665a" path="/var/lib/kubelet/pods/d6116b29-0825-47b1-a096-1a861630665a/volumes" Jul 14 16:37:22.508542 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.508520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cc8fd93-16ca-4164-8bcb-370c39906b09-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6fnkm\" (UID: \"6cc8fd93-16ca-4164-8bcb-370c39906b09\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.508850 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.508580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cc8fd93-16ca-4164-8bcb-370c39906b09-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6fnkm\" (UID: \"6cc8fd93-16ca-4164-8bcb-370c39906b09\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.508850 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.508625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98wch\" (UniqueName: \"kubernetes.io/projected/6cc8fd93-16ca-4164-8bcb-370c39906b09-kube-api-access-98wch\") pod \"kuadrant-console-plugin-66b5774985-6fnkm\" (UID: \"6cc8fd93-16ca-4164-8bcb-370c39906b09\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.509219 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.509197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cc8fd93-16ca-4164-8bcb-370c39906b09-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6fnkm\" (UID: \"6cc8fd93-16ca-4164-8bcb-370c39906b09\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.510924 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.510897 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cc8fd93-16ca-4164-8bcb-370c39906b09-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6fnkm\" (UID: \"6cc8fd93-16ca-4164-8bcb-370c39906b09\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.518322 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.518298 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98wch\" (UniqueName: \"kubernetes.io/projected/6cc8fd93-16ca-4164-8bcb-370c39906b09-kube-api-access-98wch\") pod \"kuadrant-console-plugin-66b5774985-6fnkm\" (UID: \"6cc8fd93-16ca-4164-8bcb-370c39906b09\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.533250 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.533233 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" Jul 14 16:37:22.659425 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:22.659261 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm"] Jul 14 16:37:22.662061 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:37:22.662033 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cc8fd93_16ca_4164_8bcb_370c39906b09.slice/crio-00610d5f77c66f382087bd4f0f3d75d729533d7c3bee1184c17f785476332c20 WatchSource:0}: Error finding container 00610d5f77c66f382087bd4f0f3d75d729533d7c3bee1184c17f785476332c20: Status 404 returned error can't find the container with id 00610d5f77c66f382087bd4f0f3d75d729533d7c3bee1184c17f785476332c20 Jul 14 16:37:23.510153 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:23.510114 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" event={"ID":"6cc8fd93-16ca-4164-8bcb-370c39906b09","Type":"ContainerStarted","Data":"00610d5f77c66f382087bd4f0f3d75d729533d7c3bee1184c17f785476332c20"} Jul 14 16:37:46.649039 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:46.649004 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" event={"ID":"6cc8fd93-16ca-4164-8bcb-370c39906b09","Type":"ContainerStarted","Data":"89253e86f391c8fdbaaaf94fba77254a1adf33c1b6033871bc49fdd0641bd0fd"} Jul 14 16:37:46.673247 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:37:46.673195 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fnkm" podStartSLOduration=1.530656059 podStartE2EDuration="24.673180225s" totalImagesPullingTime="23.142524166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:46.671574466 +0000 UTC m=+457.532963789" watchObservedRunningTime="2026-07-14 16:37:46.673180225 +0000 UTC m=+457.534569552" Jul 14 16:38:01.613665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.613635 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp"] Jul 14 16:38:01.631029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.631007 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.633830 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.633810 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cstjb\"" Jul 14 16:38:01.634518 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.634494 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp"] Jul 14 16:38:01.747000 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.746972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.747000 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.747003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.747233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.747023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.747233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.747039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.747233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.747088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj6x9\" (UniqueName: \"kubernetes.io/projected/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-kube-api-access-hj6x9\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.747233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.747196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.747233 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.747225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.747474 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.747252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.747474 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.747276 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.848451 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.848415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.848625 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.848465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.848625 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.848518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.848625 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.848554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.848625 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.848577 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.848625 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.848597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.848875 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.848626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj6x9\" (UniqueName: \"kubernetes.io/projected/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-kube-api-access-hj6x9\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.848875 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.848696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.848875 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.848729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.849020 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.848870 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.849067 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.849031 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.849102 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.849072 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.849134 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.849104 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.849327 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.849305 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.850932 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.850909 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.851107 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.851088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.863620 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.863601 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.865116 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.865068 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj6x9\" (UniqueName: \"kubernetes.io/projected/ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7-kube-api-access-hj6x9\") pod \"maas-default-gateway-openshift-default-56654dcf7-qs2gp\" (UID: \"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:01.943468 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:01.943427 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:02.098296 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:02.098219 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp"] Jul 14 16:38:02.100874 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:38:02.100846 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebfe732e_c4da_4f50_9bb8_dd4b57fc14f7.slice/crio-8b331c96e666b9e0dd54beb343ef1e2e8d1eace8e7be5d70d069ff9728eeda4b WatchSource:0}: Error finding container 8b331c96e666b9e0dd54beb343ef1e2e8d1eace8e7be5d70d069ff9728eeda4b: Status 404 returned error can't find the container with id 8b331c96e666b9e0dd54beb343ef1e2e8d1eace8e7be5d70d069ff9728eeda4b Jul 14 16:38:02.102970 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:02.102932 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:38:02.103055 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:02.102999 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:38:02.103055 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:02.103034 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:38:02.731633 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:02.731601 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" event={"ID":"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7","Type":"ContainerStarted","Data":"f932b6f3103dcbdfcd25fc88af5fd4950a0f3d41a9ab60ebc5535374dca9f818"} Jul 14 16:38:02.732043 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:02.731652 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" event={"ID":"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7","Type":"ContainerStarted","Data":"8b331c96e666b9e0dd54beb343ef1e2e8d1eace8e7be5d70d069ff9728eeda4b"} Jul 14 16:38:02.763996 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:02.763938 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" podStartSLOduration=1.763920288 podStartE2EDuration="1.763920288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:38:02.762726355 +0000 UTC m=+473.624115648" watchObservedRunningTime="2026-07-14 16:38:02.763920288 +0000 UTC m=+473.625309573" Jul 14 16:38:02.943653 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:02.943620 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:03.949207 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:03.949179 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:04.723843 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.723807 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-kxvxx"] Jul 14 16:38:04.727277 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.727257 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kxvxx" Jul 14 16:38:04.730225 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.730204 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7k4lv\"" Jul 14 16:38:04.735973 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.735939 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kxvxx"] Jul 14 16:38:04.743181 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.743162 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:04.744201 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.744186 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:38:04.876853 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.876821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmnm6\" (UniqueName: \"kubernetes.io/projected/0202b416-1f44-440c-8555-3265ff720526-kube-api-access-wmnm6\") pod \"authorino-58cd955675-kxvxx\" (UID: \"0202b416-1f44-440c-8555-3265ff720526\") " pod="kuadrant-system/authorino-58cd955675-kxvxx" Jul 14 16:38:04.955100 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.955063 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-54pn7"] Jul 14 16:38:04.958529 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.958512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-54pn7" Jul 14 16:38:04.967624 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.967599 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-54pn7"] Jul 14 16:38:04.978051 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.977999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmnm6\" (UniqueName: \"kubernetes.io/projected/0202b416-1f44-440c-8555-3265ff720526-kube-api-access-wmnm6\") pod \"authorino-58cd955675-kxvxx\" (UID: \"0202b416-1f44-440c-8555-3265ff720526\") " pod="kuadrant-system/authorino-58cd955675-kxvxx" Jul 14 16:38:04.993372 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:04.993352 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmnm6\" (UniqueName: \"kubernetes.io/projected/0202b416-1f44-440c-8555-3265ff720526-kube-api-access-wmnm6\") pod \"authorino-58cd955675-kxvxx\" (UID: \"0202b416-1f44-440c-8555-3265ff720526\") " pod="kuadrant-system/authorino-58cd955675-kxvxx" Jul 14 16:38:05.037247 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:05.037226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kxvxx" Jul 14 16:38:05.079638 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:05.079598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj6w8\" (UniqueName: \"kubernetes.io/projected/338bd8e0-9838-448b-bc63-cd4dc7a54492-kube-api-access-lj6w8\") pod \"authorino-75d556bd77-54pn7\" (UID: \"338bd8e0-9838-448b-bc63-cd4dc7a54492\") " pod="kuadrant-system/authorino-75d556bd77-54pn7" Jul 14 16:38:05.166820 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:05.166796 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kxvxx"] Jul 14 16:38:05.168164 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:38:05.168134 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0202b416_1f44_440c_8555_3265ff720526.slice/crio-3d0ddbf245b09bdee240492a63f35f0ff79ca6800c2485f4329e1b5b6f683e8c WatchSource:0}: Error finding container 3d0ddbf245b09bdee240492a63f35f0ff79ca6800c2485f4329e1b5b6f683e8c: Status 404 returned error can't find the container with id 3d0ddbf245b09bdee240492a63f35f0ff79ca6800c2485f4329e1b5b6f683e8c Jul 14 16:38:05.180542 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:05.180521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj6w8\" (UniqueName: \"kubernetes.io/projected/338bd8e0-9838-448b-bc63-cd4dc7a54492-kube-api-access-lj6w8\") pod \"authorino-75d556bd77-54pn7\" (UID: \"338bd8e0-9838-448b-bc63-cd4dc7a54492\") " pod="kuadrant-system/authorino-75d556bd77-54pn7" Jul 14 16:38:05.189929 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:05.189912 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj6w8\" (UniqueName: \"kubernetes.io/projected/338bd8e0-9838-448b-bc63-cd4dc7a54492-kube-api-access-lj6w8\") pod \"authorino-75d556bd77-54pn7\" (UID: \"338bd8e0-9838-448b-bc63-cd4dc7a54492\") " pod="kuadrant-system/authorino-75d556bd77-54pn7" Jul 14 16:38:05.268241 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:05.268176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-54pn7" Jul 14 16:38:05.396886 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:05.396857 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-54pn7"] Jul 14 16:38:05.398480 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:38:05.398449 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod338bd8e0_9838_448b_bc63_cd4dc7a54492.slice/crio-a4f68ce02f7f1cc33773b8f26b5cc0ff62b35d36067beae9c3af300f028f1a85 WatchSource:0}: Error finding container a4f68ce02f7f1cc33773b8f26b5cc0ff62b35d36067beae9c3af300f028f1a85: Status 404 returned error can't find the container with id a4f68ce02f7f1cc33773b8f26b5cc0ff62b35d36067beae9c3af300f028f1a85 Jul 14 16:38:05.749177 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:05.749145 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kxvxx" event={"ID":"0202b416-1f44-440c-8555-3265ff720526","Type":"ContainerStarted","Data":"3d0ddbf245b09bdee240492a63f35f0ff79ca6800c2485f4329e1b5b6f683e8c"} Jul 14 16:38:05.750338 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:05.750314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-54pn7" event={"ID":"338bd8e0-9838-448b-bc63-cd4dc7a54492","Type":"ContainerStarted","Data":"a4f68ce02f7f1cc33773b8f26b5cc0ff62b35d36067beae9c3af300f028f1a85"} Jul 14 16:38:09.479371 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:09.479340 2564 scope.go:117] "RemoveContainer" containerID="bf1dd5494c9810c7c659d7e49edef0000faf411efd10a86b6c2a9ed6bdc34d84" Jul 14 16:38:09.777661 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:09.777560 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kxvxx" event={"ID":"0202b416-1f44-440c-8555-3265ff720526","Type":"ContainerStarted","Data":"57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1"} Jul 14 16:38:09.779041 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:09.779013 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-54pn7" event={"ID":"338bd8e0-9838-448b-bc63-cd4dc7a54492","Type":"ContainerStarted","Data":"9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d"} Jul 14 16:38:09.793706 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:09.793660 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-kxvxx" podStartSLOduration=2.076111038 podStartE2EDuration="5.793646011s" totalImagesPullingTime="3.717534973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:38:09.792579603 +0000 UTC m=+480.653968886" watchObservedRunningTime="2026-07-14 16:38:09.793646011 +0000 UTC m=+480.655035294" Jul 14 16:38:09.808185 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:09.808142 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-54pn7" podStartSLOduration=2.3318606170000002 podStartE2EDuration="5.808128132s" totalImagesPullingTime="3.476267515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:38:09.80759243 +0000 UTC m=+480.668981712" watchObservedRunningTime="2026-07-14 16:38:09.808128132 +0000 UTC m=+480.669517415" Jul 14 16:38:09.833629 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:09.833601 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kxvxx"] Jul 14 16:38:11.789531 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:11.789492 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-kxvxx" podUID="0202b416-1f44-440c-8555-3265ff720526" containerName="authorino" containerID="cri-o://57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1" gracePeriod=30 Jul 14 16:38:12.042000 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.041942 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kxvxx" Jul 14 16:38:12.145096 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.145070 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmnm6\" (UniqueName: \"kubernetes.io/projected/0202b416-1f44-440c-8555-3265ff720526-kube-api-access-wmnm6\") pod \"0202b416-1f44-440c-8555-3265ff720526\" (UID: \"0202b416-1f44-440c-8555-3265ff720526\") " Jul 14 16:38:12.147036 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.147008 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0202b416-1f44-440c-8555-3265ff720526-kube-api-access-wmnm6" (OuterVolumeSpecName: "kube-api-access-wmnm6") pod "0202b416-1f44-440c-8555-3265ff720526" (UID: "0202b416-1f44-440c-8555-3265ff720526"). InnerVolumeSpecName "kube-api-access-wmnm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:38:12.246568 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.246533 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmnm6\" (UniqueName: \"kubernetes.io/projected/0202b416-1f44-440c-8555-3265ff720526-kube-api-access-wmnm6\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:38:12.795689 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.795610 2564 generic.go:356] "Generic (PLEG): container finished" podID="0202b416-1f44-440c-8555-3265ff720526" containerID="57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1" exitCode=0 Jul 14 16:38:12.795689 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.795655 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kxvxx" Jul 14 16:38:12.795689 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.795681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kxvxx" event={"ID":"0202b416-1f44-440c-8555-3265ff720526","Type":"ContainerDied","Data":"57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1"} Jul 14 16:38:12.796196 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.795719 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kxvxx" event={"ID":"0202b416-1f44-440c-8555-3265ff720526","Type":"ContainerDied","Data":"3d0ddbf245b09bdee240492a63f35f0ff79ca6800c2485f4329e1b5b6f683e8c"} Jul 14 16:38:12.796196 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.795736 2564 scope.go:117] "RemoveContainer" containerID="57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1" Jul 14 16:38:12.804851 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.804835 2564 scope.go:117] "RemoveContainer" containerID="57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1" Jul 14 16:38:12.805096 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:38:12.805077 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1\": container with ID starting with 57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1 not found: ID does not exist" containerID="57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1" Jul 14 16:38:12.805151 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.805103 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1"} err="failed to get container status \"57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1\": rpc error: code = NotFound desc = could not find container \"57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1\": container with ID starting with 57e78d3354b59680b4346f40e239e0ebede6de6f2083b67bb3249ab2f091d1b1 not found: ID does not exist" Jul 14 16:38:12.815660 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.815636 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kxvxx"] Jul 14 16:38:12.820088 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:12.820068 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-kxvxx"] Jul 14 16:38:14.488057 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:14.488018 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0202b416-1f44-440c-8555-3265ff720526" path="/var/lib/kubelet/pods/0202b416-1f44-440c-8555-3265ff720526/volumes" Jul 14 16:38:37.910667 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:37.910628 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nmn9w"] Jul 14 16:38:37.911193 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:37.911174 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0202b416-1f44-440c-8555-3265ff720526" containerName="authorino" Jul 14 16:38:37.911237 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:37.911197 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0202b416-1f44-440c-8555-3265ff720526" containerName="authorino" Jul 14 16:38:37.911321 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:37.911309 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0202b416-1f44-440c-8555-3265ff720526" containerName="authorino" Jul 14 16:38:37.914901 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:37.914879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nmn9w" Jul 14 16:38:37.919844 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:37.919820 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nmn9w"] Jul 14 16:38:37.966036 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:37.966011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8bmq\" (UniqueName: \"kubernetes.io/projected/17e3ca81-8db2-433b-95b2-a2292ee6a017-kube-api-access-b8bmq\") pod \"authorino-5d4b67c446-nmn9w\" (UID: \"17e3ca81-8db2-433b-95b2-a2292ee6a017\") " pod="kuadrant-system/authorino-5d4b67c446-nmn9w" Jul 14 16:38:38.066871 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.066840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8bmq\" (UniqueName: \"kubernetes.io/projected/17e3ca81-8db2-433b-95b2-a2292ee6a017-kube-api-access-b8bmq\") pod \"authorino-5d4b67c446-nmn9w\" (UID: \"17e3ca81-8db2-433b-95b2-a2292ee6a017\") " pod="kuadrant-system/authorino-5d4b67c446-nmn9w" Jul 14 16:38:38.076594 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.076565 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8bmq\" (UniqueName: \"kubernetes.io/projected/17e3ca81-8db2-433b-95b2-a2292ee6a017-kube-api-access-b8bmq\") pod \"authorino-5d4b67c446-nmn9w\" (UID: \"17e3ca81-8db2-433b-95b2-a2292ee6a017\") " pod="kuadrant-system/authorino-5d4b67c446-nmn9w" Jul 14 16:38:38.159508 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.159480 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nmn9w"] Jul 14 16:38:38.159718 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.159707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nmn9w" Jul 14 16:38:38.189782 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.189754 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65dd7d9986-sxx76"] Jul 14 16:38:38.193376 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.193356 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65dd7d9986-sxx76" Jul 14 16:38:38.204289 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.204267 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65dd7d9986-sxx76"] Jul 14 16:38:38.268836 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.268801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mk54\" (UniqueName: \"kubernetes.io/projected/a82eec28-514d-4c60-93bd-27cafb194781-kube-api-access-2mk54\") pod \"authorino-65dd7d9986-sxx76\" (UID: \"a82eec28-514d-4c60-93bd-27cafb194781\") " pod="kuadrant-system/authorino-65dd7d9986-sxx76" Jul 14 16:38:38.296838 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.296808 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nmn9w"] Jul 14 16:38:38.297646 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:38:38.297622 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17e3ca81_8db2_433b_95b2_a2292ee6a017.slice/crio-a977e024aabfce6048ffea4c96ea3f62c5713ca99e07dd3f6fce5b85caf67a22 WatchSource:0}: Error finding container a977e024aabfce6048ffea4c96ea3f62c5713ca99e07dd3f6fce5b85caf67a22: Status 404 returned error can't find the container with id a977e024aabfce6048ffea4c96ea3f62c5713ca99e07dd3f6fce5b85caf67a22 Jul 14 16:38:38.302097 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.302075 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65dd7d9986-sxx76"] Jul 14 16:38:38.302356 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:38:38.302336 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2mk54], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-65dd7d9986-sxx76" podUID="a82eec28-514d-4c60-93bd-27cafb194781" Jul 14 16:38:38.332174 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.332153 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7789474dfd-n6cdf"] Jul 14 16:38:38.335520 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.335505 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7789474dfd-n6cdf" Jul 14 16:38:38.338000 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.337980 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 16:38:38.343213 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.343194 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7789474dfd-n6cdf"] Jul 14 16:38:38.369999 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.369974 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mk54\" (UniqueName: \"kubernetes.io/projected/a82eec28-514d-4c60-93bd-27cafb194781-kube-api-access-2mk54\") pod \"authorino-65dd7d9986-sxx76\" (UID: \"a82eec28-514d-4c60-93bd-27cafb194781\") " pod="kuadrant-system/authorino-65dd7d9986-sxx76" Jul 14 16:38:38.370099 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.370009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/069c6453-30fb-47fe-b40a-03e3edf172c4-tls-cert\") pod \"authorino-7789474dfd-n6cdf\" (UID: \"069c6453-30fb-47fe-b40a-03e3edf172c4\") " pod="kuadrant-system/authorino-7789474dfd-n6cdf" Jul 14 16:38:38.370099 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.370058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbk6l\" (UniqueName: \"kubernetes.io/projected/069c6453-30fb-47fe-b40a-03e3edf172c4-kube-api-access-xbk6l\") pod \"authorino-7789474dfd-n6cdf\" (UID: \"069c6453-30fb-47fe-b40a-03e3edf172c4\") " pod="kuadrant-system/authorino-7789474dfd-n6cdf" Jul 14 16:38:38.379779 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.379753 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mk54\" (UniqueName: \"kubernetes.io/projected/a82eec28-514d-4c60-93bd-27cafb194781-kube-api-access-2mk54\") pod \"authorino-65dd7d9986-sxx76\" (UID: \"a82eec28-514d-4c60-93bd-27cafb194781\") " pod="kuadrant-system/authorino-65dd7d9986-sxx76" Jul 14 16:38:38.471289 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.471211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbk6l\" (UniqueName: \"kubernetes.io/projected/069c6453-30fb-47fe-b40a-03e3edf172c4-kube-api-access-xbk6l\") pod \"authorino-7789474dfd-n6cdf\" (UID: \"069c6453-30fb-47fe-b40a-03e3edf172c4\") " pod="kuadrant-system/authorino-7789474dfd-n6cdf" Jul 14 16:38:38.471289 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.471270 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/069c6453-30fb-47fe-b40a-03e3edf172c4-tls-cert\") pod \"authorino-7789474dfd-n6cdf\" (UID: \"069c6453-30fb-47fe-b40a-03e3edf172c4\") " pod="kuadrant-system/authorino-7789474dfd-n6cdf" Jul 14 16:38:38.473526 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.473508 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/069c6453-30fb-47fe-b40a-03e3edf172c4-tls-cert\") pod \"authorino-7789474dfd-n6cdf\" (UID: \"069c6453-30fb-47fe-b40a-03e3edf172c4\") " pod="kuadrant-system/authorino-7789474dfd-n6cdf" Jul 14 16:38:38.481909 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.481880 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbk6l\" (UniqueName: \"kubernetes.io/projected/069c6453-30fb-47fe-b40a-03e3edf172c4-kube-api-access-xbk6l\") pod \"authorino-7789474dfd-n6cdf\" (UID: \"069c6453-30fb-47fe-b40a-03e3edf172c4\") " pod="kuadrant-system/authorino-7789474dfd-n6cdf" Jul 14 16:38:38.645310 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.645277 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7789474dfd-n6cdf" Jul 14 16:38:38.769796 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.769774 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7789474dfd-n6cdf"] Jul 14 16:38:38.771128 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:38:38.771108 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod069c6453_30fb_47fe_b40a_03e3edf172c4.slice/crio-5b7402a04c20cb0ae00cfedb2e3abf89576347ed55c1cfa39b49f399d28ee4b1 WatchSource:0}: Error finding container 5b7402a04c20cb0ae00cfedb2e3abf89576347ed55c1cfa39b49f399d28ee4b1: Status 404 returned error can't find the container with id 5b7402a04c20cb0ae00cfedb2e3abf89576347ed55c1cfa39b49f399d28ee4b1 Jul 14 16:38:38.928990 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.928957 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nmn9w" event={"ID":"17e3ca81-8db2-433b-95b2-a2292ee6a017","Type":"ContainerStarted","Data":"a977e024aabfce6048ffea4c96ea3f62c5713ca99e07dd3f6fce5b85caf67a22"} Jul 14 16:38:38.930100 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.930077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7789474dfd-n6cdf" event={"ID":"069c6453-30fb-47fe-b40a-03e3edf172c4","Type":"ContainerStarted","Data":"5b7402a04c20cb0ae00cfedb2e3abf89576347ed55c1cfa39b49f399d28ee4b1"} Jul 14 16:38:38.930186 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.930141 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65dd7d9986-sxx76" Jul 14 16:38:38.938129 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.938112 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65dd7d9986-sxx76" Jul 14 16:38:38.976007 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.975949 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mk54\" (UniqueName: \"kubernetes.io/projected/a82eec28-514d-4c60-93bd-27cafb194781-kube-api-access-2mk54\") pod \"a82eec28-514d-4c60-93bd-27cafb194781\" (UID: \"a82eec28-514d-4c60-93bd-27cafb194781\") " Jul 14 16:38:38.977911 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:38.977889 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82eec28-514d-4c60-93bd-27cafb194781-kube-api-access-2mk54" (OuterVolumeSpecName: "kube-api-access-2mk54") pod "a82eec28-514d-4c60-93bd-27cafb194781" (UID: "a82eec28-514d-4c60-93bd-27cafb194781"). InnerVolumeSpecName "kube-api-access-2mk54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:38:39.077551 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:39.077530 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mk54\" (UniqueName: \"kubernetes.io/projected/a82eec28-514d-4c60-93bd-27cafb194781-kube-api-access-2mk54\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:38:39.937026 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:39.936983 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nmn9w" event={"ID":"17e3ca81-8db2-433b-95b2-a2292ee6a017","Type":"ContainerStarted","Data":"7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6"} Jul 14 16:38:39.937521 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:39.937025 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-nmn9w" podUID="17e3ca81-8db2-433b-95b2-a2292ee6a017" containerName="authorino" containerID="cri-o://7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6" gracePeriod=30 Jul 14 16:38:39.938598 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:39.938569 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65dd7d9986-sxx76" Jul 14 16:38:39.938709 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:39.938612 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7789474dfd-n6cdf" event={"ID":"069c6453-30fb-47fe-b40a-03e3edf172c4","Type":"ContainerStarted","Data":"bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f"} Jul 14 16:38:39.954542 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:39.954504 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-nmn9w" podStartSLOduration=2.178050966 podStartE2EDuration="2.954490205s" totalImagesPullingTime="776.439239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:38:39.952267354 +0000 UTC m=+510.813656638" watchObservedRunningTime="2026-07-14 16:38:39.954490205 +0000 UTC m=+510.815879492" Jul 14 16:38:39.980630 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:39.980602 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65dd7d9986-sxx76"] Jul 14 16:38:39.982591 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:39.982571 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65dd7d9986-sxx76"] Jul 14 16:38:39.999687 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:39.999639 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7789474dfd-n6cdf" podStartSLOduration=1.524297786 podStartE2EDuration="1.999626759s" totalImagesPullingTime="475.328973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:38:39.996685757 +0000 UTC m=+510.858075052" watchObservedRunningTime="2026-07-14 16:38:39.999626759 +0000 UTC m=+510.861016043" Jul 14 16:38:40.031328 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.031301 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-54pn7"] Jul 14 16:38:40.031519 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.031498 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-54pn7" podUID="338bd8e0-9838-448b-bc63-cd4dc7a54492" containerName="authorino" containerID="cri-o://9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d" gracePeriod=30 Jul 14 16:38:40.191422 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.191335 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nmn9w" Jul 14 16:38:40.288087 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.288059 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8bmq\" (UniqueName: \"kubernetes.io/projected/17e3ca81-8db2-433b-95b2-a2292ee6a017-kube-api-access-b8bmq\") pod \"17e3ca81-8db2-433b-95b2-a2292ee6a017\" (UID: \"17e3ca81-8db2-433b-95b2-a2292ee6a017\") " Jul 14 16:38:40.290001 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.289972 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e3ca81-8db2-433b-95b2-a2292ee6a017-kube-api-access-b8bmq" (OuterVolumeSpecName: "kube-api-access-b8bmq") pod "17e3ca81-8db2-433b-95b2-a2292ee6a017" (UID: "17e3ca81-8db2-433b-95b2-a2292ee6a017"). InnerVolumeSpecName "kube-api-access-b8bmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:38:40.330431 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.330409 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-54pn7" Jul 14 16:38:40.389428 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.389400 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj6w8\" (UniqueName: \"kubernetes.io/projected/338bd8e0-9838-448b-bc63-cd4dc7a54492-kube-api-access-lj6w8\") pod \"338bd8e0-9838-448b-bc63-cd4dc7a54492\" (UID: \"338bd8e0-9838-448b-bc63-cd4dc7a54492\") " Jul 14 16:38:40.389693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.389672 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8bmq\" (UniqueName: \"kubernetes.io/projected/17e3ca81-8db2-433b-95b2-a2292ee6a017-kube-api-access-b8bmq\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:38:40.391378 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.391358 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/338bd8e0-9838-448b-bc63-cd4dc7a54492-kube-api-access-lj6w8" (OuterVolumeSpecName: "kube-api-access-lj6w8") pod "338bd8e0-9838-448b-bc63-cd4dc7a54492" (UID: "338bd8e0-9838-448b-bc63-cd4dc7a54492"). InnerVolumeSpecName "kube-api-access-lj6w8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:38:40.489199 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.489126 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a82eec28-514d-4c60-93bd-27cafb194781" path="/var/lib/kubelet/pods/a82eec28-514d-4c60-93bd-27cafb194781/volumes" Jul 14 16:38:40.490147 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.490125 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj6w8\" (UniqueName: \"kubernetes.io/projected/338bd8e0-9838-448b-bc63-cd4dc7a54492-kube-api-access-lj6w8\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:38:40.945175 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.945140 2564 generic.go:356] "Generic (PLEG): container finished" podID="338bd8e0-9838-448b-bc63-cd4dc7a54492" containerID="9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d" exitCode=0 Jul 14 16:38:40.945610 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.945184 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-54pn7" Jul 14 16:38:40.945610 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.945227 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-54pn7" event={"ID":"338bd8e0-9838-448b-bc63-cd4dc7a54492","Type":"ContainerDied","Data":"9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d"} Jul 14 16:38:40.945610 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.945280 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-54pn7" event={"ID":"338bd8e0-9838-448b-bc63-cd4dc7a54492","Type":"ContainerDied","Data":"a4f68ce02f7f1cc33773b8f26b5cc0ff62b35d36067beae9c3af300f028f1a85"} Jul 14 16:38:40.945610 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.945305 2564 scope.go:117] "RemoveContainer" containerID="9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d" Jul 14 16:38:40.946656 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.946633 2564 generic.go:356] "Generic (PLEG): container finished" podID="17e3ca81-8db2-433b-95b2-a2292ee6a017" containerID="7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6" exitCode=0 Jul 14 16:38:40.946770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.946667 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nmn9w" event={"ID":"17e3ca81-8db2-433b-95b2-a2292ee6a017","Type":"ContainerDied","Data":"7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6"} Jul 14 16:38:40.946770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.946681 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nmn9w" Jul 14 16:38:40.946770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.946703 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nmn9w" event={"ID":"17e3ca81-8db2-433b-95b2-a2292ee6a017","Type":"ContainerDied","Data":"a977e024aabfce6048ffea4c96ea3f62c5713ca99e07dd3f6fce5b85caf67a22"} Jul 14 16:38:40.954494 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.954479 2564 scope.go:117] "RemoveContainer" containerID="9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d" Jul 14 16:38:40.954744 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:38:40.954723 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d\": container with ID starting with 9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d not found: ID does not exist" containerID="9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d" Jul 14 16:38:40.954806 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.954756 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d"} err="failed to get container status \"9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d\": rpc error: code = NotFound desc = could not find container \"9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d\": container with ID starting with 9cc28c8d6b33dc29cea2d32dcbeca21dee5a9271f93f4cafc434327332232f6d not found: ID does not exist" Jul 14 16:38:40.954806 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.954780 2564 scope.go:117] "RemoveContainer" containerID="7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6" Jul 14 16:38:40.962962 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.962944 2564 scope.go:117] "RemoveContainer" containerID="7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6" Jul 14 16:38:40.963222 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:38:40.963203 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6\": container with ID starting with 7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6 not found: ID does not exist" containerID="7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6" Jul 14 16:38:40.963267 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.963230 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6"} err="failed to get container status \"7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6\": rpc error: code = NotFound desc = could not find container \"7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6\": container with ID starting with 7f956dff38b56227701f26271ffa7126b31e286bc43569afed3d0ad8c069e1c6 not found: ID does not exist" Jul 14 16:38:40.966080 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.966061 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-54pn7"] Jul 14 16:38:40.977892 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.977874 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-54pn7"] Jul 14 16:38:40.990946 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.990924 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nmn9w"] Jul 14 16:38:40.996927 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:40.996906 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nmn9w"] Jul 14 16:38:42.488022 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:42.487983 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e3ca81-8db2-433b-95b2-a2292ee6a017" path="/var/lib/kubelet/pods/17e3ca81-8db2-433b-95b2-a2292ee6a017/volumes" Jul 14 16:38:42.488524 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:38:42.488486 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="338bd8e0-9838-448b-bc63-cd4dc7a54492" path="/var/lib/kubelet/pods/338bd8e0-9838-448b-bc63-cd4dc7a54492/volumes" Jul 14 16:39:30.195535 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:30.195501 2564 generic.go:356] "Generic (PLEG): container finished" podID="ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7" containerID="f932b6f3103dcbdfcd25fc88af5fd4950a0f3d41a9ab60ebc5535374dca9f818" exitCode=0 Jul 14 16:39:30.195931 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:30.195573 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" event={"ID":"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7","Type":"ContainerDied","Data":"f932b6f3103dcbdfcd25fc88af5fd4950a0f3d41a9ab60ebc5535374dca9f818"} Jul 14 16:39:30.195983 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:30.195951 2564 scope.go:117] "RemoveContainer" containerID="f932b6f3103dcbdfcd25fc88af5fd4950a0f3d41a9ab60ebc5535374dca9f818" Jul 14 16:39:30.196906 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:30.196883 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:39:30.196961 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:30.196941 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:39:30.196995 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:30.196970 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:39:31.203462 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:31.203424 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" event={"ID":"ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7","Type":"ContainerStarted","Data":"a4757978b19c890e0270c7c4e75cefdcf23e81be16482c9e1dec1217e1968e9c"} Jul 14 16:39:31.944234 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:31.944198 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:39:31.945439 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:31.945410 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qs2gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 14 16:39:31.945560 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:31.945462 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" podUID="ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 14 16:39:32.944193 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:32.944158 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qs2gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 14 16:39:32.944603 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:32.944211 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" podUID="ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 14 16:39:33.944125 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:33.944087 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qs2gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 14 16:39:33.944277 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:33.944141 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" podUID="ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 14 16:39:34.743934 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:34.743897 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:39:34.947335 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:34.947302 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:39:35.224456 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:39:35.224429 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qs2gp" Jul 14 16:40:04.414077 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.414044 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q"] Jul 14 16:40:04.414516 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.414414 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e3ca81-8db2-433b-95b2-a2292ee6a017" containerName="authorino" Jul 14 16:40:04.414516 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.414427 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e3ca81-8db2-433b-95b2-a2292ee6a017" containerName="authorino" Jul 14 16:40:04.414516 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.414443 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="338bd8e0-9838-448b-bc63-cd4dc7a54492" containerName="authorino" Jul 14 16:40:04.414516 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.414449 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="338bd8e0-9838-448b-bc63-cd4dc7a54492" containerName="authorino" Jul 14 16:40:04.414516 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.414504 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="338bd8e0-9838-448b-bc63-cd4dc7a54492" containerName="authorino" Jul 14 16:40:04.414516 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.414515 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e3ca81-8db2-433b-95b2-a2292ee6a017" containerName="authorino" Jul 14 16:40:04.417622 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.417606 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.421177 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.421150 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 16:40:04.422552 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.422533 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 16:40:04.422652 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.422554 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 16:40:04.422652 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.422552 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6g4q6\"" Jul 14 16:40:04.432119 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.432097 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q"] Jul 14 16:40:04.502873 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.502838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.502873 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.502877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7krq\" (UniqueName: \"kubernetes.io/projected/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-kube-api-access-j7krq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.503132 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.502910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.503132 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.502994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.503132 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.503041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.503132 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.503104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.604235 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.604198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.604235 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.604240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.604525 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.604277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.604525 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.604316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.604525 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.604341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7krq\" (UniqueName: \"kubernetes.io/projected/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-kube-api-access-j7krq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.604525 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.604376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.604689 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.604669 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.604733 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.604716 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.604775 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.604734 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.606571 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.606546 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.606741 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.606725 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.615177 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.615154 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7krq\" (UniqueName: \"kubernetes.io/projected/19ff2588-a3a0-4ca4-bd8f-b62ac2049d42-kube-api-access-j7krq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q\" (UID: \"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.726965 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.726881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:04.858205 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:04.858180 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q"] Jul 14 16:40:04.859370 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:40:04.859348 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ff2588_a3a0_4ca4_bd8f_b62ac2049d42.slice/crio-c0d5d51fa54fda6d61a8bd1b54eb8a78cdd6086faec89aa8a31437f4ca47e306 WatchSource:0}: Error finding container c0d5d51fa54fda6d61a8bd1b54eb8a78cdd6086faec89aa8a31437f4ca47e306: Status 404 returned error can't find the container with id c0d5d51fa54fda6d61a8bd1b54eb8a78cdd6086faec89aa8a31437f4ca47e306 Jul 14 16:40:05.379562 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:05.379519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" event={"ID":"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42","Type":"ContainerStarted","Data":"c0d5d51fa54fda6d61a8bd1b54eb8a78cdd6086faec89aa8a31437f4ca47e306"} Jul 14 16:40:06.386548 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:06.386465 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" event={"ID":"19ff2588-a3a0-4ca4-bd8f-b62ac2049d42","Type":"ContainerStarted","Data":"00e57fc621d3138db8d7d16806faf2be59ff2ec4ef4ec17d826b67f1f4edfa64"} Jul 14 16:40:06.410874 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:06.410825 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" podStartSLOduration=1.2378927499999999 podStartE2EDuration="2.410810149s" totalImagesPullingTime="1.172917399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:40:06.409286286 +0000 UTC m=+597.270675582" watchObservedRunningTime="2026-07-14 16:40:06.410810149 +0000 UTC m=+597.272199447" Jul 14 16:40:14.727313 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:14.727278 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:14.727811 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:14.727339 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:14.739739 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:14.739717 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:40:15.440597 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:40:15.440568 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q" Jul 14 16:41:27.976018 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:27.975978 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d877d9695-9wqnn"] Jul 14 16:41:27.979324 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:27.979306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d877d9695-9wqnn" Jul 14 16:41:27.987815 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:27.987794 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d877d9695-9wqnn"] Jul 14 16:41:28.143304 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:28.143272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3fafe409-8590-4023-a6cd-dfa0fde94572-tls-cert\") pod \"authorino-d877d9695-9wqnn\" (UID: \"3fafe409-8590-4023-a6cd-dfa0fde94572\") " pod="kuadrant-system/authorino-d877d9695-9wqnn" Jul 14 16:41:28.143304 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:28.143310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scz5c\" (UniqueName: \"kubernetes.io/projected/3fafe409-8590-4023-a6cd-dfa0fde94572-kube-api-access-scz5c\") pod \"authorino-d877d9695-9wqnn\" (UID: \"3fafe409-8590-4023-a6cd-dfa0fde94572\") " pod="kuadrant-system/authorino-d877d9695-9wqnn" Jul 14 16:41:28.244564 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:28.244464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3fafe409-8590-4023-a6cd-dfa0fde94572-tls-cert\") pod \"authorino-d877d9695-9wqnn\" (UID: \"3fafe409-8590-4023-a6cd-dfa0fde94572\") " pod="kuadrant-system/authorino-d877d9695-9wqnn" Jul 14 16:41:28.244564 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:28.244515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scz5c\" (UniqueName: \"kubernetes.io/projected/3fafe409-8590-4023-a6cd-dfa0fde94572-kube-api-access-scz5c\") pod \"authorino-d877d9695-9wqnn\" (UID: \"3fafe409-8590-4023-a6cd-dfa0fde94572\") " pod="kuadrant-system/authorino-d877d9695-9wqnn" Jul 14 16:41:28.246871 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:28.246841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3fafe409-8590-4023-a6cd-dfa0fde94572-tls-cert\") pod \"authorino-d877d9695-9wqnn\" (UID: \"3fafe409-8590-4023-a6cd-dfa0fde94572\") " pod="kuadrant-system/authorino-d877d9695-9wqnn" Jul 14 16:41:28.256501 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:28.256478 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scz5c\" (UniqueName: \"kubernetes.io/projected/3fafe409-8590-4023-a6cd-dfa0fde94572-kube-api-access-scz5c\") pod \"authorino-d877d9695-9wqnn\" (UID: \"3fafe409-8590-4023-a6cd-dfa0fde94572\") " pod="kuadrant-system/authorino-d877d9695-9wqnn" Jul 14 16:41:28.288497 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:28.288462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d877d9695-9wqnn" Jul 14 16:41:28.440677 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:28.440654 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d877d9695-9wqnn"] Jul 14 16:41:28.442835 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:41:28.442808 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fafe409_8590_4023_a6cd_dfa0fde94572.slice/crio-e06f0ef9076328911e76046d55975b4fbb116b80f68b2d878a266e332e8e2ea3 WatchSource:0}: Error finding container e06f0ef9076328911e76046d55975b4fbb116b80f68b2d878a266e332e8e2ea3: Status 404 returned error can't find the container with id e06f0ef9076328911e76046d55975b4fbb116b80f68b2d878a266e332e8e2ea3 Jul 14 16:41:28.444219 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:28.444202 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 16:41:28.804656 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:28.804622 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d877d9695-9wqnn" event={"ID":"3fafe409-8590-4023-a6cd-dfa0fde94572","Type":"ContainerStarted","Data":"e06f0ef9076328911e76046d55975b4fbb116b80f68b2d878a266e332e8e2ea3"} Jul 14 16:41:29.813399 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:29.813340 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d877d9695-9wqnn" event={"ID":"3fafe409-8590-4023-a6cd-dfa0fde94572","Type":"ContainerStarted","Data":"f4ab715e270e2a904be9b62b785c5f60743981d0e6122d65080623fb90939006"} Jul 14 16:41:29.835109 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:29.835054 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d877d9695-9wqnn" podStartSLOduration=2.221595497 podStartE2EDuration="2.835037127s" totalImagesPullingTime="613.44163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:41:29.832721374 +0000 UTC m=+680.694110658" watchObservedRunningTime="2026-07-14 16:41:29.835037127 +0000 UTC m=+680.696426410" Jul 14 16:41:29.879521 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:29.879484 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7789474dfd-n6cdf"] Jul 14 16:41:29.879977 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:29.879931 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7789474dfd-n6cdf" podUID="069c6453-30fb-47fe-b40a-03e3edf172c4" containerName="authorino" containerID="cri-o://bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f" gracePeriod=30 Jul 14 16:41:30.135046 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.135021 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7789474dfd-n6cdf" Jul 14 16:41:30.264704 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.264670 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/069c6453-30fb-47fe-b40a-03e3edf172c4-tls-cert\") pod \"069c6453-30fb-47fe-b40a-03e3edf172c4\" (UID: \"069c6453-30fb-47fe-b40a-03e3edf172c4\") " Jul 14 16:41:30.264704 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.264712 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbk6l\" (UniqueName: \"kubernetes.io/projected/069c6453-30fb-47fe-b40a-03e3edf172c4-kube-api-access-xbk6l\") pod \"069c6453-30fb-47fe-b40a-03e3edf172c4\" (UID: \"069c6453-30fb-47fe-b40a-03e3edf172c4\") " Jul 14 16:41:30.267005 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.266966 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/069c6453-30fb-47fe-b40a-03e3edf172c4-kube-api-access-xbk6l" (OuterVolumeSpecName: "kube-api-access-xbk6l") pod "069c6453-30fb-47fe-b40a-03e3edf172c4" (UID: "069c6453-30fb-47fe-b40a-03e3edf172c4"). InnerVolumeSpecName "kube-api-access-xbk6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:41:30.276169 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.276143 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/069c6453-30fb-47fe-b40a-03e3edf172c4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "069c6453-30fb-47fe-b40a-03e3edf172c4" (UID: "069c6453-30fb-47fe-b40a-03e3edf172c4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:41:30.365454 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.365360 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/069c6453-30fb-47fe-b40a-03e3edf172c4-tls-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:41:30.365454 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.365407 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbk6l\" (UniqueName: \"kubernetes.io/projected/069c6453-30fb-47fe-b40a-03e3edf172c4-kube-api-access-xbk6l\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:41:30.820894 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.820855 2564 generic.go:356] "Generic (PLEG): container finished" podID="069c6453-30fb-47fe-b40a-03e3edf172c4" containerID="bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f" exitCode=0 Jul 14 16:41:30.821372 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.820914 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7789474dfd-n6cdf" Jul 14 16:41:30.821372 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.820944 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7789474dfd-n6cdf" event={"ID":"069c6453-30fb-47fe-b40a-03e3edf172c4","Type":"ContainerDied","Data":"bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f"} Jul 14 16:41:30.821372 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.820997 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7789474dfd-n6cdf" event={"ID":"069c6453-30fb-47fe-b40a-03e3edf172c4","Type":"ContainerDied","Data":"5b7402a04c20cb0ae00cfedb2e3abf89576347ed55c1cfa39b49f399d28ee4b1"} Jul 14 16:41:30.821372 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.821021 2564 scope.go:117] "RemoveContainer" containerID="bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f" Jul 14 16:41:30.830575 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.830551 2564 scope.go:117] "RemoveContainer" containerID="bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f" Jul 14 16:41:30.830890 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:41:30.830868 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f\": container with ID starting with bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f not found: ID does not exist" containerID="bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f" Jul 14 16:41:30.830972 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.830903 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f"} err="failed to get container status \"bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f\": rpc error: code = NotFound desc = could not find container \"bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f\": container with ID starting with bc7b01e1445d6873a58c5e47cb9a89e35db04c83721cdeed476806e25cfea49f not found: ID does not exist" Jul 14 16:41:30.842336 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.842301 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7789474dfd-n6cdf"] Jul 14 16:41:30.847398 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:30.847363 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7789474dfd-n6cdf"] Jul 14 16:41:32.493327 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:41:32.493288 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="069c6453-30fb-47fe-b40a-03e3edf172c4" path="/var/lib/kubelet/pods/069c6453-30fb-47fe-b40a-03e3edf172c4/volumes" Jul 14 16:54:59.742697 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.742670 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf"] Jul 14 16:54:59.743060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.743025 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="069c6453-30fb-47fe-b40a-03e3edf172c4" containerName="authorino" Jul 14 16:54:59.743060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.743036 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="069c6453-30fb-47fe-b40a-03e3edf172c4" containerName="authorino" Jul 14 16:54:59.743132 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.743108 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="069c6453-30fb-47fe-b40a-03e3edf172c4" containerName="authorino" Jul 14 16:54:59.745982 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.745966 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.756289 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.756272 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-47ef20f4-openshift-default-dockercfg-mlnph\"" Jul 14 16:54:59.777856 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.777833 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf"] Jul 14 16:54:59.828027 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.828003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-envoy\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.828184 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.828057 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-credential-socket\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.828184 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.828077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istiod-ca-cert\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.828184 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.828174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-podinfo\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.828340 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.828223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-socket\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.828340 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.828273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-certs\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.828340 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.828300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-data\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.828340 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.828321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r75hx\" (UniqueName: \"kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-kube-api-access-r75hx\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.828516 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.828346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-token\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.929725 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.929694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-credential-socket\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.929725 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.929725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istiod-ca-cert\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.929986 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.929752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-podinfo\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.929986 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.929877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-socket\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.929986 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.929919 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-certs\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.929986 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.929947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-data\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.929986 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.929981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r75hx\" (UniqueName: \"kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-kube-api-access-r75hx\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.930241 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.930026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-token\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.930241 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.930106 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-envoy\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.930365 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.930343 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-socket\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.930453 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.930369 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-certs\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.930513 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.930451 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-credential-socket\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.930513 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.930460 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-data\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.930655 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.930639 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istiod-ca-cert\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.932227 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.932205 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-podinfo\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.932325 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.932261 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-envoy\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.952312 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.952290 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r75hx\" (UniqueName: \"kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-kube-api-access-r75hx\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:54:59.958504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:54:59.958485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-token\") pod \"e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:55:00.056430 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:00.056299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:55:00.203897 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:00.203870 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf"] Jul 14 16:55:00.207558 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:55:00.205438 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d0f87e_aac0_4ab6_b00d_5b9315b4fe5b.slice/crio-b89d2b11c52f36c47c273d3065dbfb0a80ec755007a2349c967913ac80fa511a WatchSource:0}: Error finding container b89d2b11c52f36c47c273d3065dbfb0a80ec755007a2349c967913ac80fa511a: Status 404 returned error can't find the container with id b89d2b11c52f36c47c273d3065dbfb0a80ec755007a2349c967913ac80fa511a Jul 14 16:55:00.209598 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:00.209566 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:55:00.209687 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:00.209637 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:55:00.209687 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:00.209665 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:55:00.901061 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:00.901021 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" event={"ID":"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b","Type":"ContainerStarted","Data":"af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4"} Jul 14 16:55:00.901571 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:00.901077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" event={"ID":"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b","Type":"ContainerStarted","Data":"b89d2b11c52f36c47c273d3065dbfb0a80ec755007a2349c967913ac80fa511a"} Jul 14 16:55:00.940911 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:00.940858 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" podStartSLOduration=1.9408417980000001 podStartE2EDuration="1.940841798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:55:00.93706339 +0000 UTC m=+1491.798452675" watchObservedRunningTime="2026-07-14 16:55:00.940841798 +0000 UTC m=+1491.802231080" Jul 14 16:55:01.057311 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:01.057278 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:55:01.061907 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:01.061885 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:55:01.906766 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:01.906739 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:55:01.907892 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:01.907870 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:55:06.361566 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:06.361530 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf"] Jul 14 16:55:06.362064 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:06.361766 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" podUID="e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" containerName="istio-proxy" containerID="cri-o://af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4" gracePeriod=30 Jul 14 16:55:11.611578 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.611547 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:55:11.642710 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.642679 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r75hx\" (UniqueName: \"kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-kube-api-access-r75hx\") pod \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " Jul 14 16:55:11.642920 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.642746 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-socket\") pod \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " Jul 14 16:55:11.642920 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.642776 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istiod-ca-cert\") pod \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " Jul 14 16:55:11.642920 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.642812 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-podinfo\") pod \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " Jul 14 16:55:11.642920 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.642845 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-envoy\") pod \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " Jul 14 16:55:11.642920 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.642870 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-certs\") pod \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " Jul 14 16:55:11.642920 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.642901 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-data\") pod \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " Jul 14 16:55:11.643239 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.643056 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" (UID: "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:11.643298 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.643248 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:11.643642 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.643443 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" (UID: "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:55:11.643642 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.643608 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" (UID: "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:11.645308 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.645135 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" (UID: "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:11.645974 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.645822 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" (UID: "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:11.645974 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.645932 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" (UID: "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 16:55:11.646110 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.646005 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-kube-api-access-r75hx" (OuterVolumeSpecName: "kube-api-access-r75hx") pod "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" (UID: "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b"). InnerVolumeSpecName "kube-api-access-r75hx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:55:11.743683 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.743651 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-credential-socket\") pod \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " Jul 14 16:55:11.743843 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.743805 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-token\") pod \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\" (UID: \"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b\") " Jul 14 16:55:11.743928 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.743897 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" (UID: "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:11.744125 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.744102 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r75hx\" (UniqueName: \"kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-kube-api-access-r75hx\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:11.744186 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.744130 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:11.744186 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.744145 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:11.744186 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.744158 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:11.744186 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.744172 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:11.744186 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.744184 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:11.744365 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.744196 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:11.745859 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.745829 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" (UID: "e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:55:11.845360 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.845327 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:11.958022 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.957939 2564 generic.go:356] "Generic (PLEG): container finished" podID="e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" containerID="af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4" exitCode=0 Jul 14 16:55:11.958022 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.957991 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" Jul 14 16:55:11.958220 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.958026 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" event={"ID":"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b","Type":"ContainerDied","Data":"af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4"} Jul 14 16:55:11.958220 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.958081 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf" event={"ID":"e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b","Type":"ContainerDied","Data":"b89d2b11c52f36c47c273d3065dbfb0a80ec755007a2349c967913ac80fa511a"} Jul 14 16:55:11.958220 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.958106 2564 scope.go:117] "RemoveContainer" containerID="af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4" Jul 14 16:55:11.969019 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.968491 2564 scope.go:117] "RemoveContainer" containerID="af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4" Jul 14 16:55:11.969529 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:55:11.969209 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4\": container with ID starting with af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4 not found: ID does not exist" containerID="af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4" Jul 14 16:55:11.969529 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:11.969244 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4"} err="failed to get container status \"af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4\": rpc error: code = NotFound desc = could not find container \"af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4\": container with ID starting with af9a20772a218ca607e5e97c6b59a8f66a234105d44f57ccfa3e096e917d97d4 not found: ID does not exist" Jul 14 16:55:12.001771 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:12.001745 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf"] Jul 14 16:55:12.007817 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:12.007794 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-47ef20f4-openshift-default-75465c5dcf-sfnrf"] Jul 14 16:55:12.487791 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:12.487760 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" path="/var/lib/kubelet/pods/e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b/volumes" Jul 14 16:55:13.755794 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.755766 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw"] Jul 14 16:55:13.756158 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.756104 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" containerName="istio-proxy" Jul 14 16:55:13.756158 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.756116 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" containerName="istio-proxy" Jul 14 16:55:13.756234 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.756185 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7d0f87e-aac0-4ab6-b00d-5b9315b4fe5b" containerName="istio-proxy" Jul 14 16:55:13.759291 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.759274 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.762923 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.762906 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-def21b00-openshift-default-dockercfg-jtddt\"" Jul 14 16:55:13.863051 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.863009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4gt2\" (UniqueName: \"kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-kube-api-access-h4gt2\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.863051 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.863054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-data\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.863432 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.863100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-credential-socket\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.863432 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.863210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-socket\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.863432 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.863237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-envoy\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.863432 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.863282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-certs\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.863432 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.863311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8519582-46a9-4216-a008-a16b31f209e6-istiod-ca-cert\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.863432 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.863375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-istio-token\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.863432 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.863412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8519582-46a9-4216-a008-a16b31f209e6-istio-podinfo\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.874911 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.874873 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw"] Jul 14 16:55:13.964160 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8519582-46a9-4216-a008-a16b31f209e6-istio-podinfo\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964160 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4gt2\" (UniqueName: \"kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-kube-api-access-h4gt2\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964358 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-data\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964358 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-credential-socket\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964510 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-socket\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964510 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-envoy\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964624 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-certs\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964624 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8519582-46a9-4216-a008-a16b31f209e6-istiod-ca-cert\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964624 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-istio-token\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964776 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964736 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-data\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964841 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964777 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-credential-socket\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.964989 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.964970 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-certs\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.965065 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.965041 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-socket\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.965373 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.965342 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8519582-46a9-4216-a008-a16b31f209e6-istiod-ca-cert\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.966793 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.966772 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8519582-46a9-4216-a008-a16b31f209e6-istio-podinfo\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.966793 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.966776 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-envoy\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.975347 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.975322 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4gt2\" (UniqueName: \"kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-kube-api-access-h4gt2\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:13.986545 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:13.986526 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-istio-token\") pod \"e2e-ait-def21b00-openshift-default-54c995f675-8ngxw\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:14.069526 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:14.069491 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:14.213479 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:14.213455 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw"] Jul 14 16:55:14.214010 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:55:14.213990 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8519582_46a9_4216_a008_a16b31f209e6.slice/crio-2731253f54ff9652cead704777d112433a53d6c6d85886e24f76de45e891367f WatchSource:0}: Error finding container 2731253f54ff9652cead704777d112433a53d6c6d85886e24f76de45e891367f: Status 404 returned error can't find the container with id 2731253f54ff9652cead704777d112433a53d6c6d85886e24f76de45e891367f Jul 14 16:55:14.216290 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:14.216257 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:55:14.216362 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:14.216325 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:55:14.216362 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:14.216354 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:55:14.975454 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:14.975418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" event={"ID":"e8519582-46a9-4216-a008-a16b31f209e6","Type":"ContainerStarted","Data":"210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0"} Jul 14 16:55:14.975933 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:14.975475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" event={"ID":"e8519582-46a9-4216-a008-a16b31f209e6","Type":"ContainerStarted","Data":"2731253f54ff9652cead704777d112433a53d6c6d85886e24f76de45e891367f"} Jul 14 16:55:15.014942 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:15.014886 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" podStartSLOduration=2.014866579 podStartE2EDuration="2.014866579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:55:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:55:15.013803297 +0000 UTC m=+1505.875192608" watchObservedRunningTime="2026-07-14 16:55:15.014866579 +0000 UTC m=+1505.876255862" Jul 14 16:55:15.070195 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:15.070163 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:15.075060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:15.075038 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:15.979974 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:15.979947 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:15.980900 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:15.980883 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:26.524369 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.524337 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw"] Jul 14 16:55:26.524789 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.524575 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" podUID="e8519582-46a9-4216-a008-a16b31f209e6" containerName="istio-proxy" containerID="cri-o://210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0" gracePeriod=30 Jul 14 16:55:26.667006 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.666980 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:26.778547 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.778517 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-credential-socket\") pod \"e8519582-46a9-4216-a008-a16b31f209e6\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " Jul 14 16:55:26.778693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.778555 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-data\") pod \"e8519582-46a9-4216-a008-a16b31f209e6\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " Jul 14 16:55:26.778693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.778581 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-envoy\") pod \"e8519582-46a9-4216-a008-a16b31f209e6\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " Jul 14 16:55:26.778693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.778609 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-istio-token\") pod \"e8519582-46a9-4216-a008-a16b31f209e6\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " Jul 14 16:55:26.778693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.778637 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8519582-46a9-4216-a008-a16b31f209e6-istiod-ca-cert\") pod \"e8519582-46a9-4216-a008-a16b31f209e6\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " Jul 14 16:55:26.778693 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.778668 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8519582-46a9-4216-a008-a16b31f209e6-istio-podinfo\") pod \"e8519582-46a9-4216-a008-a16b31f209e6\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " Jul 14 16:55:26.778903 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.778720 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-certs\") pod \"e8519582-46a9-4216-a008-a16b31f209e6\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " Jul 14 16:55:26.778903 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.778782 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4gt2\" (UniqueName: \"kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-kube-api-access-h4gt2\") pod \"e8519582-46a9-4216-a008-a16b31f209e6\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " Jul 14 16:55:26.778903 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.778843 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-socket\") pod \"e8519582-46a9-4216-a008-a16b31f209e6\" (UID: \"e8519582-46a9-4216-a008-a16b31f209e6\") " Jul 14 16:55:26.778903 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.778882 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8519582-46a9-4216-a008-a16b31f209e6" (UID: "e8519582-46a9-4216-a008-a16b31f209e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:26.779152 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.779131 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8519582-46a9-4216-a008-a16b31f209e6" (UID: "e8519582-46a9-4216-a008-a16b31f209e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:26.779224 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.779137 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:26.779397 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.779320 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8519582-46a9-4216-a008-a16b31f209e6" (UID: "e8519582-46a9-4216-a008-a16b31f209e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:26.779654 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.779630 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8519582-46a9-4216-a008-a16b31f209e6" (UID: "e8519582-46a9-4216-a008-a16b31f209e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:26.779947 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.779896 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8519582-46a9-4216-a008-a16b31f209e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8519582-46a9-4216-a008-a16b31f209e6" (UID: "e8519582-46a9-4216-a008-a16b31f209e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:55:26.781273 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.781246 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8519582-46a9-4216-a008-a16b31f209e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8519582-46a9-4216-a008-a16b31f209e6" (UID: "e8519582-46a9-4216-a008-a16b31f209e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 16:55:26.781375 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.781246 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8519582-46a9-4216-a008-a16b31f209e6" (UID: "e8519582-46a9-4216-a008-a16b31f209e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:26.781597 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.781565 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-kube-api-access-h4gt2" (OuterVolumeSpecName: "kube-api-access-h4gt2") pod "e8519582-46a9-4216-a008-a16b31f209e6" (UID: "e8519582-46a9-4216-a008-a16b31f209e6"). InnerVolumeSpecName "kube-api-access-h4gt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:55:26.781672 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.781577 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8519582-46a9-4216-a008-a16b31f209e6" (UID: "e8519582-46a9-4216-a008-a16b31f209e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:55:26.880077 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.880046 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4gt2\" (UniqueName: \"kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-kube-api-access-h4gt2\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:26.880077 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.880072 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:26.880077 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.880082 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:26.880294 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.880090 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:26.880294 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.880098 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8519582-46a9-4216-a008-a16b31f209e6-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:26.880294 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.880105 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8519582-46a9-4216-a008-a16b31f209e6-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:26.880294 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.880112 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8519582-46a9-4216-a008-a16b31f209e6-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:26.880294 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:26.880122 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8519582-46a9-4216-a008-a16b31f209e6-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:27.039230 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:27.039139 2564 generic.go:356] "Generic (PLEG): container finished" podID="e8519582-46a9-4216-a008-a16b31f209e6" containerID="210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0" exitCode=0 Jul 14 16:55:27.039230 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:27.039191 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" Jul 14 16:55:27.039450 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:27.039227 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" event={"ID":"e8519582-46a9-4216-a008-a16b31f209e6","Type":"ContainerDied","Data":"210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0"} Jul 14 16:55:27.039450 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:27.039277 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw" event={"ID":"e8519582-46a9-4216-a008-a16b31f209e6","Type":"ContainerDied","Data":"2731253f54ff9652cead704777d112433a53d6c6d85886e24f76de45e891367f"} Jul 14 16:55:27.039450 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:27.039299 2564 scope.go:117] "RemoveContainer" containerID="210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0" Jul 14 16:55:27.050841 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:27.050811 2564 scope.go:117] "RemoveContainer" containerID="210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0" Jul 14 16:55:27.051108 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:55:27.051088 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0\": container with ID starting with 210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0 not found: ID does not exist" containerID="210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0" Jul 14 16:55:27.051177 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:27.051118 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0"} err="failed to get container status \"210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0\": rpc error: code = NotFound desc = could not find container \"210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0\": container with ID starting with 210356dab8ffd6883e86bae7efa1676eba298fa05424e82cf2de89e3e22735b0 not found: ID does not exist" Jul 14 16:55:27.074616 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:27.074590 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw"] Jul 14 16:55:27.083089 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:27.083068 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-def21b00-openshift-default-54c995f675-8ngxw"] Jul 14 16:55:28.489044 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:28.489013 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8519582-46a9-4216-a008-a16b31f209e6" path="/var/lib/kubelet/pods/e8519582-46a9-4216-a008-a16b31f209e6/volumes" Jul 14 16:55:34.057991 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.057962 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv"] Jul 14 16:55:34.058339 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.058326 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8519582-46a9-4216-a008-a16b31f209e6" containerName="istio-proxy" Jul 14 16:55:34.058339 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.058340 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8519582-46a9-4216-a008-a16b31f209e6" containerName="istio-proxy" Jul 14 16:55:34.058438 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.058433 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8519582-46a9-4216-a008-a16b31f209e6" containerName="istio-proxy" Jul 14 16:55:34.062735 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.062719 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.072099 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.072080 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-07afec54-openshift-default-dockercfg-6hq94\"" Jul 14 16:55:34.088629 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.088601 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv"] Jul 14 16:55:34.140374 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.140344 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-token\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.140509 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.140413 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-podinfo\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.140509 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.140476 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-credential-socket\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.140509 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.140500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istiod-ca-cert\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.140615 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.140524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6wrv\" (UniqueName: \"kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-kube-api-access-b6wrv\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.140615 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.140546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-certs\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.140615 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.140571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-data\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.140705 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.140610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-envoy\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.140705 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.140658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-socket\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.241720 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.241685 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-envoy\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.241877 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.241726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-socket\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.241877 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.241755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-token\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.241877 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.241795 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-podinfo\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.241877 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.241873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-credential-socket\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.242060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.241895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istiod-ca-cert\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.242060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.241926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6wrv\" (UniqueName: \"kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-kube-api-access-b6wrv\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.242060 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.241958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-certs\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.242219 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.242151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-data\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.242272 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.242260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-socket\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.242567 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.242525 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-credential-socket\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.242567 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.242549 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-certs\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.242733 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.242570 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-data\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.242733 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.242611 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istiod-ca-cert\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.244024 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.243999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-envoy\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.244366 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.244343 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-podinfo\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.253717 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.253697 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-token\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.253820 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.253793 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6wrv\" (UniqueName: \"kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-kube-api-access-b6wrv\") pod \"e2e-derive-07afec54-openshift-default-97846d54c-gq9wv\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.373431 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.373339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:34.520869 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.520849 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv"] Jul 14 16:55:34.522656 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:55:34.522626 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b92cc6c_80e0_430f_af28_4dbfaab3cab3.slice/crio-d2d7f0c7f8d71c7ba0d8f7cb76d92a962011ceb675bddaedf768d22f8d17a250 WatchSource:0}: Error finding container d2d7f0c7f8d71c7ba0d8f7cb76d92a962011ceb675bddaedf768d22f8d17a250: Status 404 returned error can't find the container with id d2d7f0c7f8d71c7ba0d8f7cb76d92a962011ceb675bddaedf768d22f8d17a250 Jul 14 16:55:34.524665 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.524633 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:55:34.524759 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.524693 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:55:34.524759 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:34.524721 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:55:35.080244 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:35.080212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" event={"ID":"9b92cc6c-80e0-430f-af28-4dbfaab3cab3","Type":"ContainerStarted","Data":"7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008"} Jul 14 16:55:35.080647 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:35.080287 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" event={"ID":"9b92cc6c-80e0-430f-af28-4dbfaab3cab3","Type":"ContainerStarted","Data":"d2d7f0c7f8d71c7ba0d8f7cb76d92a962011ceb675bddaedf768d22f8d17a250"} Jul 14 16:55:35.110728 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:35.110678 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" podStartSLOduration=1.110661859 podStartE2EDuration="1.110661859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:55:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:55:35.10868035 +0000 UTC m=+1525.970069632" watchObservedRunningTime="2026-07-14 16:55:35.110661859 +0000 UTC m=+1525.972051141" Jul 14 16:55:35.374085 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:35.374003 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:35.378978 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:35.378956 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:36.085928 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:36.085889 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:36.086805 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:36.086786 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:39.992624 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:39.992572 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv"] Jul 14 16:55:39.993212 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:39.992814 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" podUID="9b92cc6c-80e0-430f-af28-4dbfaab3cab3" containerName="istio-proxy" containerID="cri-o://7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008" gracePeriod=30 Jul 14 16:55:45.960083 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:45.960050 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:46.051122 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051089 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-token\") pod \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " Jul 14 16:55:46.051306 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051131 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-podinfo\") pod \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " Jul 14 16:55:46.051306 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051151 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6wrv\" (UniqueName: \"kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-kube-api-access-b6wrv\") pod \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " Jul 14 16:55:46.051306 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051190 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istiod-ca-cert\") pod \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " Jul 14 16:55:46.051506 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051315 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-data\") pod \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " Jul 14 16:55:46.051506 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051358 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-credential-socket\") pod \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " Jul 14 16:55:46.051506 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051414 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-socket\") pod \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " Jul 14 16:55:46.051506 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051442 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-certs\") pod \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " Jul 14 16:55:46.051716 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051539 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-envoy\") pod \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\" (UID: \"9b92cc6c-80e0-430f-af28-4dbfaab3cab3\") " Jul 14 16:55:46.051716 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051624 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b92cc6c-80e0-430f-af28-4dbfaab3cab3" (UID: "9b92cc6c-80e0-430f-af28-4dbfaab3cab3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:55:46.051716 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051632 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b92cc6c-80e0-430f-af28-4dbfaab3cab3" (UID: "9b92cc6c-80e0-430f-af28-4dbfaab3cab3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:46.051887 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051847 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b92cc6c-80e0-430f-af28-4dbfaab3cab3" (UID: "9b92cc6c-80e0-430f-af28-4dbfaab3cab3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:46.051962 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051901 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:46.051962 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051909 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b92cc6c-80e0-430f-af28-4dbfaab3cab3" (UID: "9b92cc6c-80e0-430f-af28-4dbfaab3cab3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:46.051962 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.051931 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:46.052189 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.052153 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b92cc6c-80e0-430f-af28-4dbfaab3cab3" (UID: "9b92cc6c-80e0-430f-af28-4dbfaab3cab3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:46.053619 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.053591 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b92cc6c-80e0-430f-af28-4dbfaab3cab3" (UID: "9b92cc6c-80e0-430f-af28-4dbfaab3cab3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:55:46.053619 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.053603 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b92cc6c-80e0-430f-af28-4dbfaab3cab3" (UID: "9b92cc6c-80e0-430f-af28-4dbfaab3cab3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:55:46.053867 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.053850 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b92cc6c-80e0-430f-af28-4dbfaab3cab3" (UID: "9b92cc6c-80e0-430f-af28-4dbfaab3cab3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 16:55:46.053907 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.053869 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-kube-api-access-b6wrv" (OuterVolumeSpecName: "kube-api-access-b6wrv") pod "9b92cc6c-80e0-430f-af28-4dbfaab3cab3" (UID: "9b92cc6c-80e0-430f-af28-4dbfaab3cab3"). InnerVolumeSpecName "kube-api-access-b6wrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:55:46.136632 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.136597 2564 generic.go:356] "Generic (PLEG): container finished" podID="9b92cc6c-80e0-430f-af28-4dbfaab3cab3" containerID="7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008" exitCode=0 Jul 14 16:55:46.136805 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.136642 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" Jul 14 16:55:46.136805 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.136683 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" event={"ID":"9b92cc6c-80e0-430f-af28-4dbfaab3cab3","Type":"ContainerDied","Data":"7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008"} Jul 14 16:55:46.136805 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.136737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv" event={"ID":"9b92cc6c-80e0-430f-af28-4dbfaab3cab3","Type":"ContainerDied","Data":"d2d7f0c7f8d71c7ba0d8f7cb76d92a962011ceb675bddaedf768d22f8d17a250"} Jul 14 16:55:46.136805 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.136772 2564 scope.go:117] "RemoveContainer" containerID="7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008" Jul 14 16:55:46.146135 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.146114 2564 scope.go:117] "RemoveContainer" containerID="7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008" Jul 14 16:55:46.146376 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:55:46.146359 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008\": container with ID starting with 7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008 not found: ID does not exist" containerID="7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008" Jul 14 16:55:46.146476 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.146409 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008"} err="failed to get container status \"7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008\": rpc error: code = NotFound desc = could not find container \"7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008\": container with ID starting with 7399003f515c898d36318139f683279b8b6bd0a76cb41c7efc47659badda9008 not found: ID does not exist" Jul 14 16:55:46.153085 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.153068 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:46.153150 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.153088 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:46.153150 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.153106 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:46.153150 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.153114 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6wrv\" (UniqueName: \"kubernetes.io/projected/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-kube-api-access-b6wrv\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:46.153150 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.153124 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:46.153150 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.153132 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:46.153150 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.153140 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b92cc6c-80e0-430f-af28-4dbfaab3cab3-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:55:46.165547 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.165528 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv"] Jul 14 16:55:46.170056 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.170039 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-07afec54-openshift-default-97846d54c-gq9wv"] Jul 14 16:55:46.487309 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:55:46.487276 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b92cc6c-80e0-430f-af28-4dbfaab3cab3" path="/var/lib/kubelet/pods/9b92cc6c-80e0-430f-af28-4dbfaab3cab3/volumes" Jul 14 16:57:32.293639 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.293605 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7"] Jul 14 16:57:32.294095 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.293948 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b92cc6c-80e0-430f-af28-4dbfaab3cab3" containerName="istio-proxy" Jul 14 16:57:32.294095 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.293958 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b92cc6c-80e0-430f-af28-4dbfaab3cab3" containerName="istio-proxy" Jul 14 16:57:32.294095 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.294018 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b92cc6c-80e0-430f-af28-4dbfaab3cab3" containerName="istio-proxy" Jul 14 16:57:32.296915 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.296900 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.299920 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.299895 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4f8cd5c4-openshift-default-dockercfg-rxnh6\"" Jul 14 16:57:32.335061 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.335038 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7"] Jul 14 16:57:32.381902 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.381872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-credential-socket\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.382076 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.381906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-certs\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.382076 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.381926 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-podinfo\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.382076 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.382011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-socket\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.382076 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.382042 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-envoy\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.382076 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.382056 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-data\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.382076 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.382074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-token\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.382367 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.382186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzhx8\" (UniqueName: \"kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-kube-api-access-rzhx8\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.382367 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.382228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istiod-ca-cert\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.483655 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.483623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-socket\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.483655 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.483662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-envoy\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.483921 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.483678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-data\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.483921 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.483699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-token\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.483921 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.483727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzhx8\" (UniqueName: \"kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-kube-api-access-rzhx8\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.483921 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.483755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istiod-ca-cert\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.484127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.483928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-credential-socket\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.484127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.483959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-certs\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.484127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.483985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-podinfo\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.484127 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.484081 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-socket\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.484342 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.484160 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-data\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.484342 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.484239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-credential-socket\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.484526 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.484499 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-certs\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.484771 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.484748 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istiod-ca-cert\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.486101 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.486082 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-envoy\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.486724 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.486696 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-podinfo\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.502793 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.502771 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-token\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.505086 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.505065 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzhx8\" (UniqueName: \"kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-kube-api-access-rzhx8\") pod \"e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.607098 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.607009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:32.757791 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.757763 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7"] Jul 14 16:57:32.757907 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:57:32.757787 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1f1593_f7b0_4cbf_a77e_84d82247c8d3.slice/crio-6a71463e95c20a040ebfe48fff7fa55b7bf31d486d38945fcd9b516195a4ddb5 WatchSource:0}: Error finding container 6a71463e95c20a040ebfe48fff7fa55b7bf31d486d38945fcd9b516195a4ddb5: Status 404 returned error can't find the container with id 6a71463e95c20a040ebfe48fff7fa55b7bf31d486d38945fcd9b516195a4ddb5 Jul 14 16:57:32.759939 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.759905 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:57:32.760046 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.759999 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:57:32.760114 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:32.760043 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:57:33.679902 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:33.679856 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" event={"ID":"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3","Type":"ContainerStarted","Data":"db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5"} Jul 14 16:57:33.680292 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:33.679942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" event={"ID":"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3","Type":"ContainerStarted","Data":"6a71463e95c20a040ebfe48fff7fa55b7bf31d486d38945fcd9b516195a4ddb5"} Jul 14 16:57:33.716132 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:33.716086 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" podStartSLOduration=1.71607209 podStartE2EDuration="1.71607209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:57:33.713703122 +0000 UTC m=+1644.575092429" watchObservedRunningTime="2026-07-14 16:57:33.71607209 +0000 UTC m=+1644.577461374" Jul 14 16:57:34.608035 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:34.607999 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:34.612770 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:34.612747 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:34.684771 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:34.684732 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:34.685574 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:34.685555 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:47.753004 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:47.752926 2564 generic.go:356] "Generic (PLEG): container finished" podID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerID="db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5" exitCode=0 Jul 14 16:57:47.753416 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:47.753000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" event={"ID":"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3","Type":"ContainerDied","Data":"db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5"} Jul 14 16:57:47.753462 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:47.753414 2564 scope.go:117] "RemoveContainer" containerID="db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5" Jul 14 16:57:47.754357 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:47.754319 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:57:47.754492 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:47.754410 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:57:47.754492 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:47.754448 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:57:48.760082 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:48.760047 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" event={"ID":"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3","Type":"ContainerStarted","Data":"f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e"} Jul 14 16:57:49.608090 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:49.608055 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:49.609011 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:49.608983 2564 patch_prober.go:28] interesting pod/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 14 16:57:49.609139 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:49.609031 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 14 16:57:49.685807 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:49.685755 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:50.608071 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:50.608036 2564 patch_prober.go:28] interesting pod/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 14 16:57:50.608486 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:50.608101 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 14 16:57:51.607656 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:51.607620 2564 patch_prober.go:28] interesting pod/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 14 16:57:51.607841 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:51.607691 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 14 16:57:52.611797 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:52.611762 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:52.612956 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:52.612937 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:57:56.428718 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:56.428684 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7"] Jul 14 16:57:56.429175 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:57:56.428876 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerName="istio-proxy" containerID="cri-o://f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e" gracePeriod=30 Jul 14 16:58:01.678753 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.678724 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:58:01.831317 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.831216 2564 generic.go:356] "Generic (PLEG): container finished" podID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerID="f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e" exitCode=0 Jul 14 16:58:01.831317 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.831265 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" Jul 14 16:58:01.831317 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.831296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" event={"ID":"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3","Type":"ContainerDied","Data":"f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e"} Jul 14 16:58:01.831613 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.831347 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7" event={"ID":"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3","Type":"ContainerDied","Data":"6a71463e95c20a040ebfe48fff7fa55b7bf31d486d38945fcd9b516195a4ddb5"} Jul 14 16:58:01.831613 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.831369 2564 scope.go:117] "RemoveContainer" containerID="f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e" Jul 14 16:58:01.839956 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.839941 2564 scope.go:117] "RemoveContainer" containerID="db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5" Jul 14 16:58:01.847723 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.847706 2564 scope.go:117] "RemoveContainer" containerID="f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e" Jul 14 16:58:01.847981 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:58:01.847964 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e\": container with ID starting with f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e not found: ID does not exist" containerID="f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e" Jul 14 16:58:01.848029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.847989 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e"} err="failed to get container status \"f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e\": rpc error: code = NotFound desc = could not find container \"f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e\": container with ID starting with f76fbf064d5f351290d287fcbab714b1bf75835951388a64f276c7f29b3f3e6e not found: ID does not exist" Jul 14 16:58:01.848029 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.848007 2564 scope.go:117] "RemoveContainer" containerID="db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5" Jul 14 16:58:01.848224 ip-10-0-135-252 kubenswrapper[2564]: E0714 16:58:01.848207 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5\": container with ID starting with db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5 not found: ID does not exist" containerID="db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5" Jul 14 16:58:01.848276 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.848230 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5"} err="failed to get container status \"db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5\": rpc error: code = NotFound desc = could not find container \"db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5\": container with ID starting with db1bc51a0ad7889128228ec0f16237069ee1b67df5799df7aa35e067423ebcb5 not found: ID does not exist" Jul 14 16:58:01.855666 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.855650 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istiod-ca-cert\") pod \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " Jul 14 16:58:01.855732 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.855685 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-token\") pod \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " Jul 14 16:58:01.855732 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.855728 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-socket\") pod \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " Jul 14 16:58:01.855854 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.855835 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-certs\") pod \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " Jul 14 16:58:01.855917 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.855880 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-podinfo\") pod \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " Jul 14 16:58:01.855972 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.855950 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-envoy\") pod \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " Jul 14 16:58:01.856031 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.855970 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" (UID: "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:58:01.856031 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.855986 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-credential-socket\") pod \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " Jul 14 16:58:01.856031 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.856011 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzhx8\" (UniqueName: \"kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-kube-api-access-rzhx8\") pod \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " Jul 14 16:58:01.856184 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.856038 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" (UID: "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:58:01.856184 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.856056 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-data\") pod \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\" (UID: \"fd1f1593-f7b0-4cbf-a77e-84d82247c8d3\") " Jul 14 16:58:01.856184 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.856168 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" (UID: "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:58:01.856327 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.856241 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" (UID: "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:58:01.856504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.856444 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:58:01.856504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.856479 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:58:01.856504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.856493 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:58:01.856504 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.856507 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:58:01.857000 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.856979 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" (UID: "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:58:01.858021 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.857993 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" (UID: "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:58:01.858096 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.858023 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-kube-api-access-rzhx8" (OuterVolumeSpecName: "kube-api-access-rzhx8") pod "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" (UID: "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3"). InnerVolumeSpecName "kube-api-access-rzhx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:58:01.858318 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.858302 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" (UID: "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 16:58:01.858376 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.858312 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" (UID: "fd1f1593-f7b0-4cbf-a77e-84d82247c8d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:58:01.957819 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.957783 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:58:01.957819 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.957812 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:58:01.957819 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.957822 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:58:01.957819 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.957830 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzhx8\" (UniqueName: \"kubernetes.io/projected/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-kube-api-access-rzhx8\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:58:01.958076 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:01.957840 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 16:58:02.163978 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:02.163945 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7"] Jul 14 16:58:02.173728 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:02.173702 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4f8cd5c4-openshift-default-5fb9755795-52gd7"] Jul 14 16:58:02.488489 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:02.488456 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" path="/var/lib/kubelet/pods/fd1f1593-f7b0-4cbf-a77e-84d82247c8d3/volumes" Jul 14 16:58:19.584619 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.584585 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz"] Jul 14 16:58:19.585086 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.584956 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerName="istio-proxy" Jul 14 16:58:19.585086 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.584967 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerName="istio-proxy" Jul 14 16:58:19.585086 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.584982 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerName="istio-proxy" Jul 14 16:58:19.585086 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.584988 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerName="istio-proxy" Jul 14 16:58:19.585086 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.585051 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerName="istio-proxy" Jul 14 16:58:19.585086 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.585061 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd1f1593-f7b0-4cbf-a77e-84d82247c8d3" containerName="istio-proxy" Jul 14 16:58:19.588057 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.588041 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.594801 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.594766 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5d77ea9b-openshift-default-dockercfg-drxwm\"" Jul 14 16:58:19.612374 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.612348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-token\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.612498 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.612410 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istiod-ca-cert\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.612498 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.612457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-podinfo\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.612498 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.612479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-certs\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.612661 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.612509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-credential-socket\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.612661 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.612525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-envoy\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.612661 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.612557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c56xv\" (UniqueName: \"kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-kube-api-access-c56xv\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.612661 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.612657 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-socket\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.612798 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.612680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-data\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.617288 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.617250 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz"] Jul 14 16:58:19.713555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.713507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-socket\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.713555 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.713553 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-data\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.713816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.713581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-token\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.713816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.713607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istiod-ca-cert\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.713816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.713631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-podinfo\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.713816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.713650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-certs\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.713816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.713682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-credential-socket\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.713816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.713705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-envoy\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.713816 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.713753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c56xv\" (UniqueName: \"kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-kube-api-access-c56xv\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.714195 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.713960 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-socket\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.714195 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.714044 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-certs\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.714357 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.714335 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-credential-socket\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.714454 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.714351 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istiod-ca-cert\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.714592 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.714541 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-data\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.716159 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.716129 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-envoy\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.716289 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.716174 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-podinfo\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.740009 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.739977 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c56xv\" (UniqueName: \"kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-kube-api-access-c56xv\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.740154 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.740014 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-token\") pod \"e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:19.903587 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:19.903557 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:20.094961 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:20.094937 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz"] Jul 14 16:58:20.096452 ip-10-0-135-252 kubenswrapper[2564]: W0714 16:58:20.096425 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ad9957_fdba_4c94_8c5b_f2d2b5885f3f.slice/crio-1a44d15d38248a3922e3a16f8ed90c35eeb9153a39615e009c9728ed88a620a5 WatchSource:0}: Error finding container 1a44d15d38248a3922e3a16f8ed90c35eeb9153a39615e009c9728ed88a620a5: Status 404 returned error can't find the container with id 1a44d15d38248a3922e3a16f8ed90c35eeb9153a39615e009c9728ed88a620a5 Jul 14 16:58:20.098658 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:20.098624 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:58:20.098748 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:20.098705 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:58:20.098818 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:20.098750 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:58:20.934428 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:20.934371 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" event={"ID":"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f","Type":"ContainerStarted","Data":"7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d"} Jul 14 16:58:20.934826 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:20.934446 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" event={"ID":"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f","Type":"ContainerStarted","Data":"1a44d15d38248a3922e3a16f8ed90c35eeb9153a39615e009c9728ed88a620a5"} Jul 14 16:58:20.977701 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:20.977654 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" podStartSLOduration=1.977638252 podStartE2EDuration="1.977638252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:58:20.975053755 +0000 UTC m=+1691.836443039" watchObservedRunningTime="2026-07-14 16:58:20.977638252 +0000 UTC m=+1691.839027534" Jul 14 16:58:21.904039 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:21.904001 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:21.908903 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:21.908877 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:21.941642 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:21.941612 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:21.942482 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:21.942462 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:36.024561 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:36.024521 2564 generic.go:356] "Generic (PLEG): container finished" podID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerID="7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d" exitCode=0 Jul 14 16:58:36.025125 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:36.024577 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" event={"ID":"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f","Type":"ContainerDied","Data":"7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d"} Jul 14 16:58:36.025125 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:36.025106 2564 scope.go:117] "RemoveContainer" containerID="7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d" Jul 14 16:58:36.026131 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:36.026101 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:58:36.026242 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:36.026177 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:58:36.026242 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:36.026209 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:58:36.941928 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:36.941885 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:37.031776 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:37.031735 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" event={"ID":"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f","Type":"ContainerStarted","Data":"6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06"} Jul 14 16:58:37.903952 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:37.903909 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:37.905064 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:37.905036 2564 patch_prober.go:28] interesting pod/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 14 16:58:37.905198 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:37.905087 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 14 16:58:38.904275 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:38.904240 2564 patch_prober.go:28] interesting pod/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 14 16:58:38.904696 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:38.904306 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 14 16:58:39.904535 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:39.904498 2564 patch_prober.go:28] interesting pod/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 14 16:58:39.904931 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:39.904567 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 14 16:58:40.904749 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:40.904714 2564 patch_prober.go:28] interesting pod/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 14 16:58:40.905143 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:40.904766 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 14 16:58:41.908755 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:41.908720 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:41.909216 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:41.909195 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 16:58:41.910072 ip-10-0-135-252 kubenswrapper[2564]: I0714 16:58:41.910045 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 17:00:09.192975 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:09.192940 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz"] Jul 14 17:00:09.193488 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:09.193141 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" containerID="cri-o://6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06" gracePeriod=30 Jul 14 17:00:11.911843 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:11.911807 2564 patch_prober.go:28] interesting pod/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 17:00:11.912224 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:11.911868 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 17:00:14.441987 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.441961 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 17:00:14.536212 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536138 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c56xv\" (UniqueName: \"kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-kube-api-access-c56xv\") pod \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " Jul 14 17:00:14.536212 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536201 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-token\") pod \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " Jul 14 17:00:14.536424 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536335 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-certs\") pod \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " Jul 14 17:00:14.536424 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536407 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-socket\") pod \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " Jul 14 17:00:14.536518 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536442 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-credential-socket\") pod \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " Jul 14 17:00:14.536518 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536475 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-podinfo\") pod \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " Jul 14 17:00:14.536518 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536509 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-envoy\") pod \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " Jul 14 17:00:14.536684 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536534 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-data\") pod \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " Jul 14 17:00:14.536684 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536574 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istiod-ca-cert\") pod \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\" (UID: \"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f\") " Jul 14 17:00:14.536684 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536628 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" (UID: "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:00:14.536840 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536697 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" (UID: "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:00:14.536840 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536752 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" (UID: "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:00:14.537011 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536919 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:00:14.537011 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536940 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:00:14.537011 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.536955 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:00:14.537181 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.537005 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" (UID: "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:00:14.537828 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.537798 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-data" (OuterVolumeSpecName: "istio-data") pod "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" (UID: "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:00:14.538654 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.538631 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" (UID: "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 17:00:14.538711 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.538676 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-token" (OuterVolumeSpecName: "istio-token") pod "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" (UID: "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:00:14.538804 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.538789 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-kube-api-access-c56xv" (OuterVolumeSpecName: "kube-api-access-c56xv") pod "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" (UID: "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f"). InnerVolumeSpecName "kube-api-access-c56xv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:00:14.538858 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.538846 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" (UID: "82ad9957-fdba-4c94-8c5b-f2d2b5885f3f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:00:14.546222 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.546197 2564 generic.go:356] "Generic (PLEG): container finished" podID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerID="6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06" exitCode=0 Jul 14 17:00:14.546296 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.546253 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" Jul 14 17:00:14.546296 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.546278 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" event={"ID":"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f","Type":"ContainerDied","Data":"6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06"} Jul 14 17:00:14.546392 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.546328 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz" event={"ID":"82ad9957-fdba-4c94-8c5b-f2d2b5885f3f","Type":"ContainerDied","Data":"1a44d15d38248a3922e3a16f8ed90c35eeb9153a39615e009c9728ed88a620a5"} Jul 14 17:00:14.546392 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.546350 2564 scope.go:117] "RemoveContainer" containerID="6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06" Jul 14 17:00:14.558789 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.558772 2564 scope.go:117] "RemoveContainer" containerID="7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d" Jul 14 17:00:14.566812 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.566795 2564 scope.go:117] "RemoveContainer" containerID="6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06" Jul 14 17:00:14.567097 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:00:14.567080 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06\": container with ID starting with 6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06 not found: ID does not exist" containerID="6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06" Jul 14 17:00:14.567148 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.567104 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06"} err="failed to get container status \"6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06\": rpc error: code = NotFound desc = could not find container \"6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06\": container with ID starting with 6d595f33f97490269b724d53306b27791bdc884f4f792ee024dcb0eba2fdbf06 not found: ID does not exist" Jul 14 17:00:14.567148 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.567122 2564 scope.go:117] "RemoveContainer" containerID="7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d" Jul 14 17:00:14.567330 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:00:14.567316 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d\": container with ID starting with 7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d not found: ID does not exist" containerID="7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d" Jul 14 17:00:14.567370 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.567335 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d"} err="failed to get container status \"7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d\": rpc error: code = NotFound desc = could not find container \"7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d\": container with ID starting with 7f52151fc49f00fba6265f6221cabb568e4723af6632a096051817f41bfbbd8d not found: ID does not exist" Jul 14 17:00:14.578189 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.578160 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz"] Jul 14 17:00:14.585507 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.585485 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5d77ea9b-openshift-default-5f9cdf487-7rnkz"] Jul 14 17:00:14.638462 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.638420 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:00:14.638462 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.638450 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:00:14.638462 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.638462 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:00:14.638462 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.638476 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:00:14.638821 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.638489 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:00:14.638821 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:14.638502 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c56xv\" (UniqueName: \"kubernetes.io/projected/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f-kube-api-access-c56xv\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:00:16.489345 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:00:16.489305 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" path="/var/lib/kubelet/pods/82ad9957-fdba-4c94-8c5b-f2d2b5885f3f/volumes" Jul 14 17:01:09.029717 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.029676 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw"] Jul 14 17:01:09.030313 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.030219 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" Jul 14 17:01:09.030313 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.030238 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" Jul 14 17:01:09.030468 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.030338 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" Jul 14 17:01:09.030468 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.030354 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" Jul 14 17:01:09.033529 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.033509 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.038350 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.038329 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1c66bf-openshift-default-dockercfg-rjqvw\"" Jul 14 17:01:09.060555 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.060524 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw"] Jul 14 17:01:09.108793 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.108764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a96dc412-c024-4d2d-ace3-a27500941dfa-istiod-ca-cert\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.108950 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.108798 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z78v9\" (UniqueName: \"kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-kube-api-access-z78v9\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.108950 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.108823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-credential-socket\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.108950 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.108848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-data\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.108950 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.108912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-envoy\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.109106 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.108948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-podinfo\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.109106 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.108980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-token\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.109106 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.109032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-certs\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.109106 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.109049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-socket\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210082 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-token\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210234 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-certs\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210234 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-socket\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210330 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a96dc412-c024-4d2d-ace3-a27500941dfa-istiod-ca-cert\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210369 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210336 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z78v9\" (UniqueName: \"kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-kube-api-access-z78v9\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210442 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-credential-socket\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210442 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-data\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210524 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-envoy\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210524 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-podinfo\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210618 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210606 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-certs\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210668 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210642 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-socket\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.210854 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.210831 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-data\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.211174 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.211142 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a96dc412-c024-4d2d-ace3-a27500941dfa-istiod-ca-cert\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.211328 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.211306 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-credential-socket\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.213589 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.213567 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-podinfo\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.213764 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.213741 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-envoy\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.244479 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.244449 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z78v9\" (UniqueName: \"kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-kube-api-access-z78v9\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.247407 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.247359 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-token\") pod \"e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.344088 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.344015 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:09.492081 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.492028 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw"] Jul 14 17:01:09.494286 ip-10-0-135-252 kubenswrapper[2564]: W0714 17:01:09.494260 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96dc412_c024_4d2d_ace3_a27500941dfa.slice/crio-292f2ebc8fae27e120ee71e52909eb13e84e08aedf3054bc60032ff1074ff2b2 WatchSource:0}: Error finding container 292f2ebc8fae27e120ee71e52909eb13e84e08aedf3054bc60032ff1074ff2b2: Status 404 returned error can't find the container with id 292f2ebc8fae27e120ee71e52909eb13e84e08aedf3054bc60032ff1074ff2b2 Jul 14 17:01:09.496196 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.496169 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:09.496258 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.496232 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:09.496295 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.496263 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:09.824110 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.824076 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" event={"ID":"a96dc412-c024-4d2d-ace3-a27500941dfa","Type":"ContainerStarted","Data":"f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86"} Jul 14 17:01:09.824291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.824132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" event={"ID":"a96dc412-c024-4d2d-ace3-a27500941dfa","Type":"ContainerStarted","Data":"292f2ebc8fae27e120ee71e52909eb13e84e08aedf3054bc60032ff1074ff2b2"} Jul 14 17:01:09.853790 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:09.853743 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" podStartSLOduration=1.853728802 podStartE2EDuration="1.853728802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:01:09.850448124 +0000 UTC m=+1860.711837455" watchObservedRunningTime="2026-07-14 17:01:09.853728802 +0000 UTC m=+1860.715118085" Jul 14 17:01:10.344777 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:10.344750 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:10.349466 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:10.349441 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:10.829195 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:10.829163 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:10.830200 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:10.830178 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:17.666146 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.666115 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r"] Jul 14 17:01:17.666548 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.666491 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" Jul 14 17:01:17.666548 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.666503 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ad9957-fdba-4c94-8c5b-f2d2b5885f3f" containerName="istio-proxy" Jul 14 17:01:17.669606 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.669591 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.672435 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.672410 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3a7c08-openshift-default-dockercfg-96kw6\"" Jul 14 17:01:17.684822 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.684798 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r"] Jul 14 17:01:17.788053 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.788018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-envoy\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.788053 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.788056 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-certs\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.788291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.788100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-token\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.788291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.788121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dctr\" (UniqueName: \"kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-kube-api-access-5dctr\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.788291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.788151 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-data\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.788291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.788190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-socket\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.788291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.788216 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-credential-socket\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.788291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.788233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-podinfo\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.788291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.788255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istiod-ca-cert\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.889733 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.889690 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-podinfo\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.889733 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.889737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istiod-ca-cert\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.889958 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.889797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-envoy\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.889958 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.889820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-certs\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.889958 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.889863 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-token\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.889958 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.889882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dctr\" (UniqueName: \"kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-kube-api-access-5dctr\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.889958 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.889905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-data\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.889958 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.889932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-socket\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.890246 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.889978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-credential-socket\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.890414 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.890372 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-credential-socket\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.890530 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.890466 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-certs\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.890530 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.890519 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-socket\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.890624 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.890546 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-data\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.890726 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.890709 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istiod-ca-cert\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.892142 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.892119 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-envoy\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.892249 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.892218 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-podinfo\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.901075 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.901049 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dctr\" (UniqueName: \"kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-kube-api-access-5dctr\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.902927 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.902903 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-token\") pod \"e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:17.980050 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:17.979977 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:18.131874 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:18.131836 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r"] Jul 14 17:01:18.134210 ip-10-0-135-252 kubenswrapper[2564]: W0714 17:01:18.134188 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87dfffc4_059a_47c5_82f4_0666c3ba95c1.slice/crio-12277a4416cfc5fc5481de45f39fec879486c99cf1d306d18115f592e22aeebe WatchSource:0}: Error finding container 12277a4416cfc5fc5481de45f39fec879486c99cf1d306d18115f592e22aeebe: Status 404 returned error can't find the container with id 12277a4416cfc5fc5481de45f39fec879486c99cf1d306d18115f592e22aeebe Jul 14 17:01:18.136230 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:18.136199 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:18.136292 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:18.136265 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:18.136333 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:18.136295 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:18.872054 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:18.872021 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" event={"ID":"87dfffc4-059a-47c5-82f4-0666c3ba95c1","Type":"ContainerStarted","Data":"9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd"} Jul 14 17:01:18.872460 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:18.872075 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" event={"ID":"87dfffc4-059a-47c5-82f4-0666c3ba95c1","Type":"ContainerStarted","Data":"12277a4416cfc5fc5481de45f39fec879486c99cf1d306d18115f592e22aeebe"} Jul 14 17:01:18.908594 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:18.908546 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" podStartSLOduration=1.908529879 podStartE2EDuration="1.908529879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:01:18.905151101 +0000 UTC m=+1869.766540427" watchObservedRunningTime="2026-07-14 17:01:18.908529879 +0000 UTC m=+1869.769919240" Jul 14 17:01:18.980432 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:18.980400 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:19.985237 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:19.985207 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:20.882234 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:20.882203 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:20.883124 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:20.883103 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:30.940947 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:30.940912 2564 generic.go:356] "Generic (PLEG): container finished" podID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerID="f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86" exitCode=0 Jul 14 17:01:30.941349 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:30.940989 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" event={"ID":"a96dc412-c024-4d2d-ace3-a27500941dfa","Type":"ContainerDied","Data":"f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86"} Jul 14 17:01:30.941468 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:30.941452 2564 scope.go:117] "RemoveContainer" containerID="f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86" Jul 14 17:01:30.942554 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:30.942523 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:30.942637 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:30.942593 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:30.942637 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:30.942626 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:31.950535 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:31.950498 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" event={"ID":"a96dc412-c024-4d2d-ace3-a27500941dfa","Type":"ContainerStarted","Data":"fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce"} Jul 14 17:01:32.345108 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:32.345023 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:32.345361 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:32.345338 2564 patch_prober.go:28] interesting pod/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 14 17:01:32.345488 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:32.345423 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 14 17:01:33.345359 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:33.345322 2564 patch_prober.go:28] interesting pod/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 14 17:01:33.345840 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:33.345417 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 14 17:01:34.345091 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:34.345052 2564 patch_prober.go:28] interesting pod/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 14 17:01:34.345269 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:34.345107 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 14 17:01:35.344741 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:35.344639 2564 patch_prober.go:28] interesting pod/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 14 17:01:35.344741 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:35.344698 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 14 17:01:35.884435 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:35.884375 2564 patch_prober.go:28] interesting pod/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 14 17:01:35.884613 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:35.884452 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 14 17:01:35.973788 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:35.973749 2564 generic.go:356] "Generic (PLEG): container finished" podID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerID="9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd" exitCode=0 Jul 14 17:01:35.973976 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:35.973818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" event={"ID":"87dfffc4-059a-47c5-82f4-0666c3ba95c1","Type":"ContainerDied","Data":"9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd"} Jul 14 17:01:35.974332 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:35.974315 2564 scope.go:117] "RemoveContainer" containerID="9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd" Jul 14 17:01:35.975476 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:35.975447 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:35.975546 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:35.975515 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:35.975593 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:35.975546 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:01:36.348152 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:36.348125 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:36.348563 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:36.348515 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:36.349111 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:36.349094 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:01:36.985060 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:36.985017 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" event={"ID":"87dfffc4-059a-47c5-82f4-0666c3ba95c1","Type":"ContainerStarted","Data":"aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886"} Jul 14 17:01:37.980867 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:37.980836 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:37.981470 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:37.980890 2564 patch_prober.go:28] interesting pod/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 14 17:01:37.981651 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:37.981626 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 14 17:01:38.980652 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:38.980611 2564 patch_prober.go:28] interesting pod/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 14 17:01:38.980859 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:38.980686 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 14 17:01:39.981260 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:39.981226 2564 patch_prober.go:28] interesting pod/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 14 17:01:39.981968 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:39.981936 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 14 17:01:40.984161 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:40.984127 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:40.984623 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:40.984602 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:01:40.985277 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:01:40.985258 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:03:31.186914 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:31.186876 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw"] Jul 14 17:03:31.187420 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:31.187078 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" containerID="cri-o://fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce" gracePeriod=30 Jul 14 17:03:36.350120 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.350080 2564 patch_prober.go:28] interesting pod/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 14 17:03:36.350612 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.350134 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 14 17:03:36.437206 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.437182 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:03:36.444541 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.444522 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-socket\") pod \"a96dc412-c024-4d2d-ace3-a27500941dfa\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " Jul 14 17:03:36.444628 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.444572 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-envoy\") pod \"a96dc412-c024-4d2d-ace3-a27500941dfa\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " Jul 14 17:03:36.444628 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.444598 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-data\") pod \"a96dc412-c024-4d2d-ace3-a27500941dfa\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " Jul 14 17:03:36.444700 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.444633 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-podinfo\") pod \"a96dc412-c024-4d2d-ace3-a27500941dfa\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " Jul 14 17:03:36.444700 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.444650 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z78v9\" (UniqueName: \"kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-kube-api-access-z78v9\") pod \"a96dc412-c024-4d2d-ace3-a27500941dfa\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " Jul 14 17:03:36.444700 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.444668 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-credential-socket\") pod \"a96dc412-c024-4d2d-ace3-a27500941dfa\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " Jul 14 17:03:36.444700 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.444694 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-token\") pod \"a96dc412-c024-4d2d-ace3-a27500941dfa\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " Jul 14 17:03:36.444874 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.444782 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a96dc412-c024-4d2d-ace3-a27500941dfa" (UID: "a96dc412-c024-4d2d-ace3-a27500941dfa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:36.444874 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.444846 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a96dc412-c024-4d2d-ace3-a27500941dfa-istiod-ca-cert\") pod \"a96dc412-c024-4d2d-ace3-a27500941dfa\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " Jul 14 17:03:36.444982 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.444899 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-certs\") pod \"a96dc412-c024-4d2d-ace3-a27500941dfa\" (UID: \"a96dc412-c024-4d2d-ace3-a27500941dfa\") " Jul 14 17:03:36.445407 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.445227 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:36.445407 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.445237 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a96dc412-c024-4d2d-ace3-a27500941dfa" (UID: "a96dc412-c024-4d2d-ace3-a27500941dfa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:36.445588 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.445507 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-data" (OuterVolumeSpecName: "istio-data") pod "a96dc412-c024-4d2d-ace3-a27500941dfa" (UID: "a96dc412-c024-4d2d-ace3-a27500941dfa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:36.445588 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.445554 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a96dc412-c024-4d2d-ace3-a27500941dfa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a96dc412-c024-4d2d-ace3-a27500941dfa" (UID: "a96dc412-c024-4d2d-ace3-a27500941dfa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:03:36.445815 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.445786 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a96dc412-c024-4d2d-ace3-a27500941dfa" (UID: "a96dc412-c024-4d2d-ace3-a27500941dfa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:36.446988 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.446936 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a96dc412-c024-4d2d-ace3-a27500941dfa" (UID: "a96dc412-c024-4d2d-ace3-a27500941dfa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:36.446988 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.446946 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-kube-api-access-z78v9" (OuterVolumeSpecName: "kube-api-access-z78v9") pod "a96dc412-c024-4d2d-ace3-a27500941dfa" (UID: "a96dc412-c024-4d2d-ace3-a27500941dfa"). InnerVolumeSpecName "kube-api-access-z78v9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:03:36.446988 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.446935 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a96dc412-c024-4d2d-ace3-a27500941dfa" (UID: "a96dc412-c024-4d2d-ace3-a27500941dfa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 17:03:36.447237 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.447218 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-token" (OuterVolumeSpecName: "istio-token") pod "a96dc412-c024-4d2d-ace3-a27500941dfa" (UID: "a96dc412-c024-4d2d-ace3-a27500941dfa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:03:36.545821 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.545791 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:36.545821 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.545816 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:36.545821 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.545824 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:36.546077 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.545834 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:36.546077 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.545842 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z78v9\" (UniqueName: \"kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-kube-api-access-z78v9\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:36.546077 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.545921 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96dc412-c024-4d2d-ace3-a27500941dfa-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:36.546077 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.545930 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a96dc412-c024-4d2d-ace3-a27500941dfa-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:36.546077 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.545938 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a96dc412-c024-4d2d-ace3-a27500941dfa-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:36.626370 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.626340 2564 generic.go:356] "Generic (PLEG): container finished" podID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerID="fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce" exitCode=0 Jul 14 17:03:36.626552 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.626405 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" Jul 14 17:03:36.626552 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.626427 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" event={"ID":"a96dc412-c024-4d2d-ace3-a27500941dfa","Type":"ContainerDied","Data":"fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce"} Jul 14 17:03:36.626552 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.626489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw" event={"ID":"a96dc412-c024-4d2d-ace3-a27500941dfa","Type":"ContainerDied","Data":"292f2ebc8fae27e120ee71e52909eb13e84e08aedf3054bc60032ff1074ff2b2"} Jul 14 17:03:36.626552 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.626520 2564 scope.go:117] "RemoveContainer" containerID="fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce" Jul 14 17:03:36.635746 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.635727 2564 scope.go:117] "RemoveContainer" containerID="f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86" Jul 14 17:03:36.643507 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.643491 2564 scope.go:117] "RemoveContainer" containerID="fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce" Jul 14 17:03:36.643787 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:03:36.643766 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce\": container with ID starting with fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce not found: ID does not exist" containerID="fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce" Jul 14 17:03:36.643833 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.643797 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce"} err="failed to get container status \"fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce\": rpc error: code = NotFound desc = could not find container \"fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce\": container with ID starting with fc5932fbf278d81ee8b965dcd65c405a9b7356e4d876047e159baccd12a86fce not found: ID does not exist" Jul 14 17:03:36.643833 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.643815 2564 scope.go:117] "RemoveContainer" containerID="f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86" Jul 14 17:03:36.644070 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:03:36.644053 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86\": container with ID starting with f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86 not found: ID does not exist" containerID="f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86" Jul 14 17:03:36.644108 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.644076 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86"} err="failed to get container status \"f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86\": rpc error: code = NotFound desc = could not find container \"f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86\": container with ID starting with f60285f3b54f5e0cb3da7411ed5e882828bf21e07d83625e7cf330a528304c86 not found: ID does not exist" Jul 14 17:03:36.651787 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.651758 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw"] Jul 14 17:03:36.654684 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:36.654661 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1c66bf-openshift-default-57cc7cd94f-xh6xw"] Jul 14 17:03:38.488237 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:38.488197 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" path="/var/lib/kubelet/pods/a96dc412-c024-4d2d-ace3-a27500941dfa/volumes" Jul 14 17:03:39.630723 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:39.630691 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r"] Jul 14 17:03:39.631183 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:39.630971 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" containerID="cri-o://aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886" gracePeriod=30 Jul 14 17:03:40.691212 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.691182 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2"] Jul 14 17:03:40.691675 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.691526 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" Jul 14 17:03:40.691675 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.691538 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" Jul 14 17:03:40.691675 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.691610 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" Jul 14 17:03:40.691675 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.691618 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" Jul 14 17:03:40.695832 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.695816 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.698873 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.698853 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-417196-openshift-default-dockercfg-ssh2k\"" Jul 14 17:03:40.712432 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.712412 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2"] Jul 14 17:03:40.782622 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.782593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-socket\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.782835 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.782626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00acf07a-5f23-42f7-8cec-7e41330c22fa-istiod-ca-cert\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.782835 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.782657 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7hjg\" (UniqueName: \"kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-kube-api-access-r7hjg\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.782835 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.782713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-token\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.782835 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.782756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-data\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.782835 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.782782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-podinfo\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.782835 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.782810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-envoy\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.782835 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.782831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-credential-socket\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.783154 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.782915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-certs\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.883779 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.883744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-token\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.883779 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.883784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-data\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884067 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.883808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-podinfo\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884067 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.883840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-envoy\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884067 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.883861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-credential-socket\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884067 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.883904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-certs\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884067 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.883998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-socket\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884067 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.884022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00acf07a-5f23-42f7-8cec-7e41330c22fa-istiod-ca-cert\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884067 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.884049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7hjg\" (UniqueName: \"kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-kube-api-access-r7hjg\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884484 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.884368 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-credential-socket\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884484 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.884443 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-certs\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884484 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.884475 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-socket\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884765 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.884745 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-data\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.884765 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.884759 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00acf07a-5f23-42f7-8cec-7e41330c22fa-istiod-ca-cert\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.886164 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.886144 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-envoy\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.886553 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.886530 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-podinfo\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.895973 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.895945 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7hjg\" (UniqueName: \"kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-kube-api-access-r7hjg\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.896911 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.896890 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-token\") pod \"e2e-api-a-417196-openshift-default-5956499cb7-h6xx2\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:40.986744 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.986658 2564 patch_prober.go:28] interesting pod/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 17:03:40.986744 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:40.986712 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 17:03:41.005839 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:41.005808 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:41.167319 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:41.167289 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2"] Jul 14 17:03:41.168238 ip-10-0-135-252 kubenswrapper[2564]: W0714 17:03:41.168215 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00acf07a_5f23_42f7_8cec_7e41330c22fa.slice/crio-7cbe0b2195fbd84f076efe4413c2e0817cf091a0bce45d27dcf8cba49012c1ea WatchSource:0}: Error finding container 7cbe0b2195fbd84f076efe4413c2e0817cf091a0bce45d27dcf8cba49012c1ea: Status 404 returned error can't find the container with id 7cbe0b2195fbd84f076efe4413c2e0817cf091a0bce45d27dcf8cba49012c1ea Jul 14 17:03:41.170345 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:41.170307 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:03:41.170465 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:41.170399 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:03:41.170465 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:41.170450 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:03:41.658248 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:41.658219 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" event={"ID":"00acf07a-5f23-42f7-8cec-7e41330c22fa","Type":"ContainerStarted","Data":"a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c"} Jul 14 17:03:41.658470 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:41.658265 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" event={"ID":"00acf07a-5f23-42f7-8cec-7e41330c22fa","Type":"ContainerStarted","Data":"7cbe0b2195fbd84f076efe4413c2e0817cf091a0bce45d27dcf8cba49012c1ea"} Jul 14 17:03:41.687113 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:41.687068 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" podStartSLOduration=1.687053647 podStartE2EDuration="1.687053647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:03:41.68442386 +0000 UTC m=+2012.545813143" watchObservedRunningTime="2026-07-14 17:03:41.687053647 +0000 UTC m=+2012.548442929" Jul 14 17:03:42.007059 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:42.006970 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:42.012014 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:42.011989 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:42.663541 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:42.663514 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:42.664549 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:42.664530 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:44.885145 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.885117 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:03:44.920954 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.920923 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-data\") pod \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " Jul 14 17:03:44.921119 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.920963 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dctr\" (UniqueName: \"kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-kube-api-access-5dctr\") pod \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " Jul 14 17:03:44.921119 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921032 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-token\") pod \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " Jul 14 17:03:44.921119 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921053 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-credential-socket\") pod \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " Jul 14 17:03:44.921119 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921078 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-podinfo\") pod \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " Jul 14 17:03:44.921119 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921101 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istiod-ca-cert\") pod \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " Jul 14 17:03:44.921331 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921143 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-certs\") pod \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " Jul 14 17:03:44.921331 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921197 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-socket\") pod \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " Jul 14 17:03:44.921331 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921231 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-envoy\") pod \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\" (UID: \"87dfffc4-059a-47c5-82f4-0666c3ba95c1\") " Jul 14 17:03:44.921490 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921357 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87dfffc4-059a-47c5-82f4-0666c3ba95c1" (UID: "87dfffc4-059a-47c5-82f4-0666c3ba95c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:44.921721 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921623 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:44.921721 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921605 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87dfffc4-059a-47c5-82f4-0666c3ba95c1" (UID: "87dfffc4-059a-47c5-82f4-0666c3ba95c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:44.921721 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921673 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87dfffc4-059a-47c5-82f4-0666c3ba95c1" (UID: "87dfffc4-059a-47c5-82f4-0666c3ba95c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:03:44.922037 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921831 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87dfffc4-059a-47c5-82f4-0666c3ba95c1" (UID: "87dfffc4-059a-47c5-82f4-0666c3ba95c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:44.922037 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.921902 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "87dfffc4-059a-47c5-82f4-0666c3ba95c1" (UID: "87dfffc4-059a-47c5-82f4-0666c3ba95c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:44.923377 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.923352 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-kube-api-access-5dctr" (OuterVolumeSpecName: "kube-api-access-5dctr") pod "87dfffc4-059a-47c5-82f4-0666c3ba95c1" (UID: "87dfffc4-059a-47c5-82f4-0666c3ba95c1"). InnerVolumeSpecName "kube-api-access-5dctr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:03:44.923377 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.923366 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87dfffc4-059a-47c5-82f4-0666c3ba95c1" (UID: "87dfffc4-059a-47c5-82f4-0666c3ba95c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 17:03:44.923681 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.923665 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "87dfffc4-059a-47c5-82f4-0666c3ba95c1" (UID: "87dfffc4-059a-47c5-82f4-0666c3ba95c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:03:44.923825 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:44.923811 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87dfffc4-059a-47c5-82f4-0666c3ba95c1" (UID: "87dfffc4-059a-47c5-82f4-0666c3ba95c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:45.022524 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.022490 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:45.022524 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.022516 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dctr\" (UniqueName: \"kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-kube-api-access-5dctr\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:45.022524 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.022525 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:45.022524 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.022533 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:45.022789 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.022541 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:45.022789 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.022549 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:45.022789 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.022557 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:45.022789 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.022564 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87dfffc4-059a-47c5-82f4-0666c3ba95c1-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:03:45.679346 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.679310 2564 generic.go:356] "Generic (PLEG): container finished" podID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerID="aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886" exitCode=0 Jul 14 17:03:45.679538 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.679363 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" Jul 14 17:03:45.679538 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.679414 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" event={"ID":"87dfffc4-059a-47c5-82f4-0666c3ba95c1","Type":"ContainerDied","Data":"aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886"} Jul 14 17:03:45.679538 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.679473 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r" event={"ID":"87dfffc4-059a-47c5-82f4-0666c3ba95c1","Type":"ContainerDied","Data":"12277a4416cfc5fc5481de45f39fec879486c99cf1d306d18115f592e22aeebe"} Jul 14 17:03:45.679538 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.679498 2564 scope.go:117] "RemoveContainer" containerID="aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886" Jul 14 17:03:45.691127 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.691095 2564 scope.go:117] "RemoveContainer" containerID="9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd" Jul 14 17:03:45.699565 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.699550 2564 scope.go:117] "RemoveContainer" containerID="aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886" Jul 14 17:03:45.699811 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:03:45.699792 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886\": container with ID starting with aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886 not found: ID does not exist" containerID="aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886" Jul 14 17:03:45.699893 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.699824 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886"} err="failed to get container status \"aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886\": rpc error: code = NotFound desc = could not find container \"aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886\": container with ID starting with aa4055566a561b6b771824ee97ac6306616b0132bd856584b2b6be4cb4902886 not found: ID does not exist" Jul 14 17:03:45.699893 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.699849 2564 scope.go:117] "RemoveContainer" containerID="9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd" Jul 14 17:03:45.700091 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:03:45.700075 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd\": container with ID starting with 9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd not found: ID does not exist" containerID="9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd" Jul 14 17:03:45.700128 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.700097 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd"} err="failed to get container status \"9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd\": rpc error: code = NotFound desc = could not find container \"9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd\": container with ID starting with 9402f1e96ac362a712b9bf0a8aff32c3f487f60fd10d44050aaf973ffe5b45bd not found: ID does not exist" Jul 14 17:03:45.714718 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.714700 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r"] Jul 14 17:03:45.722344 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:45.722321 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3a7c08-openshift-default-7cd47c6879-kcw9r"] Jul 14 17:03:46.487431 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:46.487401 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" path="/var/lib/kubelet/pods/87dfffc4-059a-47c5-82f4-0666c3ba95c1/volumes" Jul 14 17:03:49.416496 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.416469 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps"] Jul 14 17:03:49.416992 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.416974 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" Jul 14 17:03:49.417076 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.416995 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" Jul 14 17:03:49.417076 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.417020 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" Jul 14 17:03:49.417076 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.417028 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96dc412-c024-4d2d-ace3-a27500941dfa" containerName="istio-proxy" Jul 14 17:03:49.417222 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.417118 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" Jul 14 17:03:49.423465 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.423434 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.427278 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.427258 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-845e65-openshift-default-dockercfg-bnmtt\"" Jul 14 17:03:49.444936 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.444911 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps"] Jul 14 17:03:49.461128 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.461108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-socket\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.461247 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.461160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-certs\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.461247 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.461195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74827688-9e17-4130-a8ff-705e4082df72-istiod-ca-cert\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.461247 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.461220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74827688-9e17-4130-a8ff-705e4082df72-istio-podinfo\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.461438 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.461258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-istio-token\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.461438 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.461341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txdfq\" (UniqueName: \"kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-kube-api-access-txdfq\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.461438 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.461367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-envoy\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.461438 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.461413 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-credential-socket\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.461597 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.461443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-data\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562187 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txdfq\" (UniqueName: \"kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-kube-api-access-txdfq\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562187 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-envoy\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562479 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-credential-socket\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562479 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562234 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-data\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562479 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-socket\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562479 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-certs\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562479 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74827688-9e17-4130-a8ff-705e4082df72-istiod-ca-cert\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562479 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74827688-9e17-4130-a8ff-705e4082df72-istio-podinfo\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562479 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-istio-token\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562793 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562668 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-credential-socket\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562854 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562807 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-data\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562890 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562854 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-socket\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.562931 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.562905 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-certs\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.563243 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.563215 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74827688-9e17-4130-a8ff-705e4082df72-istiod-ca-cert\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.564871 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.564841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-envoy\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.564871 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.564870 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74827688-9e17-4130-a8ff-705e4082df72-istio-podinfo\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.575938 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.575888 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-istio-token\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.586353 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.586316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txdfq\" (UniqueName: \"kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-kube-api-access-txdfq\") pod \"e2e-api-b-845e65-openshift-default-db6854759-p88ps\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.734211 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.734120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:49.919080 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.919057 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps"] Jul 14 17:03:49.920565 ip-10-0-135-252 kubenswrapper[2564]: W0714 17:03:49.920534 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74827688_9e17_4130_a8ff_705e4082df72.slice/crio-c8a58779c54ae28ac8ccaa61def012ddb346d6bafa925e69890951e2bb496c3c WatchSource:0}: Error finding container c8a58779c54ae28ac8ccaa61def012ddb346d6bafa925e69890951e2bb496c3c: Status 404 returned error can't find the container with id c8a58779c54ae28ac8ccaa61def012ddb346d6bafa925e69890951e2bb496c3c Jul 14 17:03:49.922503 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.922469 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:03:49.922569 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.922531 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:03:49.922569 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:49.922560 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:03:50.707598 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:50.707561 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" event={"ID":"74827688-9e17-4130-a8ff-705e4082df72","Type":"ContainerStarted","Data":"164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee"} Jul 14 17:03:50.708008 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:50.707621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" event={"ID":"74827688-9e17-4130-a8ff-705e4082df72","Type":"ContainerStarted","Data":"c8a58779c54ae28ac8ccaa61def012ddb346d6bafa925e69890951e2bb496c3c"} Jul 14 17:03:50.734406 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:50.734367 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:50.736038 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:50.736011 2564 patch_prober.go:28] interesting pod/e2e-api-b-845e65-openshift-default-db6854759-p88ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 14 17:03:50.736163 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:50.736067 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 14 17:03:50.756961 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:50.756911 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" podStartSLOduration=1.756890953 podStartE2EDuration="1.756890953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:03:50.755300541 +0000 UTC m=+2021.616689850" watchObservedRunningTime="2026-07-14 17:03:50.756890953 +0000 UTC m=+2021.618280238" Jul 14 17:03:51.738395 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:51.738350 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:52.718557 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:52.718530 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:52.719543 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:52.719523 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:03:56.746174 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:56.746140 2564 generic.go:356] "Generic (PLEG): container finished" podID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerID="a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c" exitCode=0 Jul 14 17:03:56.746614 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:56.746211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" event={"ID":"00acf07a-5f23-42f7-8cec-7e41330c22fa","Type":"ContainerDied","Data":"a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c"} Jul 14 17:03:56.746678 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:56.746661 2564 scope.go:117] "RemoveContainer" containerID="a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c" Jul 14 17:03:56.747816 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:56.747784 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:03:56.747947 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:56.747866 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:03:56.747947 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:56.747928 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:03:57.663837 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:57.663805 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:57.752971 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:57.752939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" event={"ID":"00acf07a-5f23-42f7-8cec-7e41330c22fa","Type":"ContainerStarted","Data":"ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e"} Jul 14 17:03:58.006781 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:58.006696 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:03:58.007866 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:58.007835 2564 patch_prober.go:28] interesting pod/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 14 17:03:58.008026 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:58.007894 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 14 17:03:59.006751 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:59.006720 2564 patch_prober.go:28] interesting pod/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 14 17:03:59.007165 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:03:59.006784 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 14 17:04:00.007115 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:00.007072 2564 patch_prober.go:28] interesting pod/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 14 17:04:00.007560 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:00.007125 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 14 17:04:01.006714 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:01.006676 2564 patch_prober.go:28] interesting pod/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 14 17:04:01.006889 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:01.006738 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 14 17:04:02.010609 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:02.010574 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:04:02.010996 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:02.010927 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:04:02.011603 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:02.011586 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:04:08.760531 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:08.760485 2564 patch_prober.go:28] interesting pod/e2e-api-b-845e65-openshift-default-db6854759-p88ps container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 17:04:08.760980 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:08.760557 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 14 17:04:09.829662 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:09.829629 2564 generic.go:356] "Generic (PLEG): container finished" podID="74827688-9e17-4130-a8ff-705e4082df72" containerID="164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee" exitCode=0 Jul 14 17:04:09.830136 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:09.829706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" event={"ID":"74827688-9e17-4130-a8ff-705e4082df72","Type":"ContainerDied","Data":"164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee"} Jul 14 17:04:09.830235 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:09.830219 2564 scope.go:117] "RemoveContainer" containerID="164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee" Jul 14 17:04:09.831232 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:09.831203 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:09.831358 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:09.831286 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:09.831358 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:09.831333 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:10.837801 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:10.837768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" event={"ID":"74827688-9e17-4130-a8ff-705e4082df72","Type":"ContainerStarted","Data":"ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226"} Jul 14 17:04:11.734976 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:11.734945 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:04:11.735142 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:11.735121 2564 patch_prober.go:28] interesting pod/e2e-api-b-845e65-openshift-default-db6854759-p88ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 14 17:04:11.735193 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:11.735161 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 14 17:04:12.734558 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:12.734525 2564 patch_prober.go:28] interesting pod/e2e-api-b-845e65-openshift-default-db6854759-p88ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 14 17:04:12.735017 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:12.734578 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 14 17:04:13.735446 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:13.735412 2564 patch_prober.go:28] interesting pod/e2e-api-b-845e65-openshift-default-db6854759-p88ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 14 17:04:13.735850 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:13.735466 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 14 17:04:14.738812 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:14.738784 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:04:14.739243 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:14.739231 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:04:14.740631 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:14.740607 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:04:14.896126 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:14.896082 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2"] Jul 14 17:04:14.896309 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:14.896278 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" containerID="cri-o://ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e" gracePeriod=30 Jul 14 17:04:17.013247 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:17.013212 2564 patch_prober.go:28] interesting pod/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 14 17:04:17.013637 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:17.013264 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 17:04:20.155472 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.155369 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:04:20.163526 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163503 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7hjg\" (UniqueName: \"kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-kube-api-access-r7hjg\") pod \"00acf07a-5f23-42f7-8cec-7e41330c22fa\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " Jul 14 17:04:20.163615 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163535 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-socket\") pod \"00acf07a-5f23-42f7-8cec-7e41330c22fa\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " Jul 14 17:04:20.163615 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163556 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-credential-socket\") pod \"00acf07a-5f23-42f7-8cec-7e41330c22fa\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " Jul 14 17:04:20.163615 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163582 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-token\") pod \"00acf07a-5f23-42f7-8cec-7e41330c22fa\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " Jul 14 17:04:20.163615 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163610 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-podinfo\") pod \"00acf07a-5f23-42f7-8cec-7e41330c22fa\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " Jul 14 17:04:20.163807 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163643 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-data\") pod \"00acf07a-5f23-42f7-8cec-7e41330c22fa\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " Jul 14 17:04:20.163807 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163719 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00acf07a-5f23-42f7-8cec-7e41330c22fa-istiod-ca-cert\") pod \"00acf07a-5f23-42f7-8cec-7e41330c22fa\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " Jul 14 17:04:20.163807 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163747 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-certs\") pod \"00acf07a-5f23-42f7-8cec-7e41330c22fa\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " Jul 14 17:04:20.163807 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163790 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00acf07a-5f23-42f7-8cec-7e41330c22fa" (UID: "00acf07a-5f23-42f7-8cec-7e41330c22fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:04:20.164029 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163810 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-envoy\") pod \"00acf07a-5f23-42f7-8cec-7e41330c22fa\" (UID: \"00acf07a-5f23-42f7-8cec-7e41330c22fa\") " Jul 14 17:04:20.164174 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.163804 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00acf07a-5f23-42f7-8cec-7e41330c22fa" (UID: "00acf07a-5f23-42f7-8cec-7e41330c22fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:04:20.164174 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.164171 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:20.164357 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.164024 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00acf07a-5f23-42f7-8cec-7e41330c22fa" (UID: "00acf07a-5f23-42f7-8cec-7e41330c22fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:04:20.164357 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.164123 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00acf07a-5f23-42f7-8cec-7e41330c22fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00acf07a-5f23-42f7-8cec-7e41330c22fa" (UID: "00acf07a-5f23-42f7-8cec-7e41330c22fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:04:20.164609 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.164585 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "00acf07a-5f23-42f7-8cec-7e41330c22fa" (UID: "00acf07a-5f23-42f7-8cec-7e41330c22fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:04:20.165752 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.165717 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "00acf07a-5f23-42f7-8cec-7e41330c22fa" (UID: "00acf07a-5f23-42f7-8cec-7e41330c22fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:04:20.165908 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.165800 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-kube-api-access-r7hjg" (OuterVolumeSpecName: "kube-api-access-r7hjg") pod "00acf07a-5f23-42f7-8cec-7e41330c22fa" (UID: "00acf07a-5f23-42f7-8cec-7e41330c22fa"). InnerVolumeSpecName "kube-api-access-r7hjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:04:20.166136 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.166113 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00acf07a-5f23-42f7-8cec-7e41330c22fa" (UID: "00acf07a-5f23-42f7-8cec-7e41330c22fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 17:04:20.166200 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.166117 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00acf07a-5f23-42f7-8cec-7e41330c22fa" (UID: "00acf07a-5f23-42f7-8cec-7e41330c22fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:04:20.265281 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.265249 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7hjg\" (UniqueName: \"kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-kube-api-access-r7hjg\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:20.265281 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.265277 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:20.265497 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.265291 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:20.265497 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.265303 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:20.265497 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.265316 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:20.265497 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.265326 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00acf07a-5f23-42f7-8cec-7e41330c22fa-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:20.265497 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.265337 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:20.265497 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.265346 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00acf07a-5f23-42f7-8cec-7e41330c22fa-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:20.894265 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.894230 2564 generic.go:356] "Generic (PLEG): container finished" podID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerID="ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e" exitCode=0 Jul 14 17:04:20.894465 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.894277 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" Jul 14 17:04:20.894465 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.894323 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" event={"ID":"00acf07a-5f23-42f7-8cec-7e41330c22fa","Type":"ContainerDied","Data":"ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e"} Jul 14 17:04:20.894465 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.894378 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2" event={"ID":"00acf07a-5f23-42f7-8cec-7e41330c22fa","Type":"ContainerDied","Data":"7cbe0b2195fbd84f076efe4413c2e0817cf091a0bce45d27dcf8cba49012c1ea"} Jul 14 17:04:20.894465 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.894422 2564 scope.go:117] "RemoveContainer" containerID="ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e" Jul 14 17:04:20.902905 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.902888 2564 scope.go:117] "RemoveContainer" containerID="a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c" Jul 14 17:04:20.911225 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.911208 2564 scope.go:117] "RemoveContainer" containerID="ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e" Jul 14 17:04:20.911506 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:04:20.911488 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e\": container with ID starting with ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e not found: ID does not exist" containerID="ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e" Jul 14 17:04:20.911572 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.911516 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e"} err="failed to get container status \"ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e\": rpc error: code = NotFound desc = could not find container \"ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e\": container with ID starting with ef55dcb9bb972a3ac868fee262ff6dff33e97e5ef3418307115ab402a130b18e not found: ID does not exist" Jul 14 17:04:20.911572 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.911539 2564 scope.go:117] "RemoveContainer" containerID="a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c" Jul 14 17:04:20.911747 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:04:20.911732 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c\": container with ID starting with a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c not found: ID does not exist" containerID="a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c" Jul 14 17:04:20.911794 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.911751 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c"} err="failed to get container status \"a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c\": rpc error: code = NotFound desc = could not find container \"a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c\": container with ID starting with a27e2d717c713216914dd0542c8055d6d6ae7288685be020f91ad3e49132f01c not found: ID does not exist" Jul 14 17:04:20.943321 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.943286 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2"] Jul 14 17:04:20.950055 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:20.950033 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-417196-openshift-default-5956499cb7-h6xx2"] Jul 14 17:04:22.488534 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:22.488505 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" path="/var/lib/kubelet/pods/00acf07a-5f23-42f7-8cec-7e41330c22fa/volumes" Jul 14 17:04:24.844366 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:24.844335 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps"] Jul 14 17:04:24.844744 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:24.844557 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" containerID="cri-o://ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226" gracePeriod=30 Jul 14 17:04:25.864684 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.864647 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5"] Jul 14 17:04:25.865081 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.865001 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" Jul 14 17:04:25.865081 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.865011 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" Jul 14 17:04:25.865081 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.865027 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" Jul 14 17:04:25.865081 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.865032 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" Jul 14 17:04:25.865081 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.865041 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" Jul 14 17:04:25.865081 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.865047 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" Jul 14 17:04:25.865308 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.865109 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" Jul 14 17:04:25.865308 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.865118 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87dfffc4-059a-47c5-82f4-0666c3ba95c1" containerName="istio-proxy" Jul 14 17:04:25.869691 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.869673 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:25.874588 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.874565 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-2f2de5-openshift-default-dockercfg-5hth7\"" Jul 14 17:04:25.900851 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.900825 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5"] Jul 14 17:04:25.914396 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.914356 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-envoy\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:25.914511 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.914406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f720231b-a1a9-4527-b487-846979f9ad76-istiod-ca-cert\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:25.914511 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.914427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5rz9\" (UniqueName: \"kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-kube-api-access-p5rz9\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:25.914511 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.914484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-credential-socket\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:25.914681 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.914548 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-socket\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:25.914681 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.914584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-data\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:25.914681 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.914617 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-certs\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:25.914681 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.914656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f720231b-a1a9-4527-b487-846979f9ad76-istio-podinfo\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:25.914847 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:25.914696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-istio-token\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016124 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-credential-socket\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016323 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-socket\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016323 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-data\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016323 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-certs\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016323 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f720231b-a1a9-4527-b487-846979f9ad76-istio-podinfo\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016323 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-istio-token\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016323 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-envoy\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016666 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f720231b-a1a9-4527-b487-846979f9ad76-istiod-ca-cert\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016666 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5rz9\" (UniqueName: \"kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-kube-api-access-p5rz9\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016666 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016652 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-socket\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016818 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016700 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-data\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016818 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-certs\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.016914 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.016837 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-credential-socket\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.017134 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.017116 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f720231b-a1a9-4527-b487-846979f9ad76-istiod-ca-cert\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.018659 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.018631 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-envoy\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.018876 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.018857 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f720231b-a1a9-4527-b487-846979f9ad76-istio-podinfo\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.027495 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.027472 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-istio-token\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.027804 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.027784 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5rz9\" (UniqueName: \"kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-kube-api-access-p5rz9\") pod \"e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.180239 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.180205 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:26.339015 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.338845 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5"] Jul 14 17:04:26.341443 ip-10-0-135-252 kubenswrapper[2564]: W0714 17:04:26.341414 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf720231b_a1a9_4527_b487_846979f9ad76.slice/crio-012b5bb2d23c441f3477d924b99e1d9492d7e7c1b2fa08c4a6750f6ff5119c15 WatchSource:0}: Error finding container 012b5bb2d23c441f3477d924b99e1d9492d7e7c1b2fa08c4a6750f6ff5119c15: Status 404 returned error can't find the container with id 012b5bb2d23c441f3477d924b99e1d9492d7e7c1b2fa08c4a6750f6ff5119c15 Jul 14 17:04:26.343635 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.343604 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:26.343738 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.343668 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:26.343738 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.343694 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:26.927273 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.927234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" event={"ID":"f720231b-a1a9-4527-b487-846979f9ad76","Type":"ContainerStarted","Data":"0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee"} Jul 14 17:04:26.927750 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.927297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" event={"ID":"f720231b-a1a9-4527-b487-846979f9ad76","Type":"ContainerStarted","Data":"012b5bb2d23c441f3477d924b99e1d9492d7e7c1b2fa08c4a6750f6ff5119c15"} Jul 14 17:04:26.958790 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:26.958748 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" podStartSLOduration=1.958733118 podStartE2EDuration="1.958733118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:04:26.954422552 +0000 UTC m=+2057.815811832" watchObservedRunningTime="2026-07-14 17:04:26.958733118 +0000 UTC m=+2057.820122401" Jul 14 17:04:27.181466 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:27.181368 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:27.186156 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:27.186132 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:27.932202 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:27.932172 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:27.933230 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:27.933212 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:29.741500 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:29.741465 2564 patch_prober.go:28] interesting pod/e2e-api-b-845e65-openshift-default-db6854759-p88ps container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 17:04:29.741858 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:29.741522 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 17:04:30.092149 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.092125 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:04:30.154231 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154201 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74827688-9e17-4130-a8ff-705e4082df72-istio-podinfo\") pod \"74827688-9e17-4130-a8ff-705e4082df72\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " Jul 14 17:04:30.154231 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154235 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-certs\") pod \"74827688-9e17-4130-a8ff-705e4082df72\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " Jul 14 17:04:30.154481 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154252 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-envoy\") pod \"74827688-9e17-4130-a8ff-705e4082df72\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " Jul 14 17:04:30.154481 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154280 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txdfq\" (UniqueName: \"kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-kube-api-access-txdfq\") pod \"74827688-9e17-4130-a8ff-705e4082df72\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " Jul 14 17:04:30.154481 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154438 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-credential-socket\") pod \"74827688-9e17-4130-a8ff-705e4082df72\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " Jul 14 17:04:30.154481 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154480 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-data\") pod \"74827688-9e17-4130-a8ff-705e4082df72\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " Jul 14 17:04:30.154700 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154508 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74827688-9e17-4130-a8ff-705e4082df72-istiod-ca-cert\") pod \"74827688-9e17-4130-a8ff-705e4082df72\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " Jul 14 17:04:30.154700 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154566 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-istio-token\") pod \"74827688-9e17-4130-a8ff-705e4082df72\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " Jul 14 17:04:30.154700 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154596 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74827688-9e17-4130-a8ff-705e4082df72" (UID: "74827688-9e17-4130-a8ff-705e4082df72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:04:30.154700 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154690 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-socket\") pod \"74827688-9e17-4130-a8ff-705e4082df72\" (UID: \"74827688-9e17-4130-a8ff-705e4082df72\") " Jul 14 17:04:30.154914 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.154717 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74827688-9e17-4130-a8ff-705e4082df72" (UID: "74827688-9e17-4130-a8ff-705e4082df72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:04:30.155039 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.155013 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74827688-9e17-4130-a8ff-705e4082df72-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74827688-9e17-4130-a8ff-705e4082df72" (UID: "74827688-9e17-4130-a8ff-705e4082df72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:04:30.155129 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.155066 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:30.155129 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.155085 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:30.155280 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.155259 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74827688-9e17-4130-a8ff-705e4082df72" (UID: "74827688-9e17-4130-a8ff-705e4082df72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:04:30.155465 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.155439 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-data" (OuterVolumeSpecName: "istio-data") pod "74827688-9e17-4130-a8ff-705e4082df72" (UID: "74827688-9e17-4130-a8ff-705e4082df72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:04:30.156637 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.156610 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-istio-token" (OuterVolumeSpecName: "istio-token") pod "74827688-9e17-4130-a8ff-705e4082df72" (UID: "74827688-9e17-4130-a8ff-705e4082df72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:04:30.156740 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.156639 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74827688-9e17-4130-a8ff-705e4082df72-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74827688-9e17-4130-a8ff-705e4082df72" (UID: "74827688-9e17-4130-a8ff-705e4082df72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 17:04:30.156882 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.156863 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-kube-api-access-txdfq" (OuterVolumeSpecName: "kube-api-access-txdfq") pod "74827688-9e17-4130-a8ff-705e4082df72" (UID: "74827688-9e17-4130-a8ff-705e4082df72"). InnerVolumeSpecName "kube-api-access-txdfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:04:30.156950 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.156935 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74827688-9e17-4130-a8ff-705e4082df72" (UID: "74827688-9e17-4130-a8ff-705e4082df72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:04:30.256563 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.256534 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:30.256563 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.256556 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74827688-9e17-4130-a8ff-705e4082df72-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:30.256563 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.256566 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:30.256777 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.256574 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txdfq\" (UniqueName: \"kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-kube-api-access-txdfq\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:30.256777 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.256584 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74827688-9e17-4130-a8ff-705e4082df72-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:30.256777 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.256593 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74827688-9e17-4130-a8ff-705e4082df72-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:30.256777 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.256601 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74827688-9e17-4130-a8ff-705e4082df72-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:04:30.948087 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.948056 2564 generic.go:356] "Generic (PLEG): container finished" podID="74827688-9e17-4130-a8ff-705e4082df72" containerID="ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226" exitCode=0 Jul 14 17:04:30.948613 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.948102 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" Jul 14 17:04:30.948613 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.948145 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" event={"ID":"74827688-9e17-4130-a8ff-705e4082df72","Type":"ContainerDied","Data":"ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226"} Jul 14 17:04:30.948613 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.948214 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps" event={"ID":"74827688-9e17-4130-a8ff-705e4082df72","Type":"ContainerDied","Data":"c8a58779c54ae28ac8ccaa61def012ddb346d6bafa925e69890951e2bb496c3c"} Jul 14 17:04:30.948613 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.948250 2564 scope.go:117] "RemoveContainer" containerID="ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226" Jul 14 17:04:30.957504 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.957483 2564 scope.go:117] "RemoveContainer" containerID="164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee" Jul 14 17:04:30.965961 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.965800 2564 scope.go:117] "RemoveContainer" containerID="ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226" Jul 14 17:04:30.966090 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:04:30.966070 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226\": container with ID starting with ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226 not found: ID does not exist" containerID="ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226" Jul 14 17:04:30.966137 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.966098 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226"} err="failed to get container status \"ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226\": rpc error: code = NotFound desc = could not find container \"ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226\": container with ID starting with ba89b64d872800d4f1ac862fa7cbc71b0750e1ccb68ff13060652e5e066c3226 not found: ID does not exist" Jul 14 17:04:30.966137 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.966118 2564 scope.go:117] "RemoveContainer" containerID="164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee" Jul 14 17:04:30.966355 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:04:30.966339 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee\": container with ID starting with 164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee not found: ID does not exist" containerID="164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee" Jul 14 17:04:30.966418 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.966360 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee"} err="failed to get container status \"164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee\": rpc error: code = NotFound desc = could not find container \"164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee\": container with ID starting with 164498749e9e13e314e150e2dab308bffb8133c5afdfb22f0d8cf483b08a85ee not found: ID does not exist" Jul 14 17:04:30.994236 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:30.994212 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps"] Jul 14 17:04:31.020362 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:31.020338 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-845e65-openshift-default-db6854759-p88ps"] Jul 14 17:04:32.488273 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:32.488242 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74827688-9e17-4130-a8ff-705e4082df72" path="/var/lib/kubelet/pods/74827688-9e17-4130-a8ff-705e4082df72/volumes" Jul 14 17:04:34.495846 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.495820 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl"] Jul 14 17:04:34.496223 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.496148 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" Jul 14 17:04:34.496223 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.496159 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" Jul 14 17:04:34.496291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.496226 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="00acf07a-5f23-42f7-8cec-7e41330c22fa" containerName="istio-proxy" Jul 14 17:04:34.496291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.496233 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" Jul 14 17:04:34.496291 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.496240 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" Jul 14 17:04:34.500634 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.500618 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.511122 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.511102 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-21db6d-openshift-default-dockercfg-ldzfl\"" Jul 14 17:04:34.526852 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.526829 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl"] Jul 14 17:04:34.596406 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.596278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-podinfo\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.596406 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.596354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-envoy\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.596680 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.596437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-token\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.596680 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.596477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-credential-socket\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.596680 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.596504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-data\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.596680 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.596596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfqn4\" (UniqueName: \"kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-kube-api-access-pfqn4\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.596680 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.596637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-socket\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.596680 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.596666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istiod-ca-cert\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.596992 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.596698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-certs\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.697376 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.697338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-podinfo\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.697376 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.697392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-envoy\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.697651 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.697433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-token\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.697651 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.697456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-credential-socket\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.697651 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.697471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-data\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.697651 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.697496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfqn4\" (UniqueName: \"kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-kube-api-access-pfqn4\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.697651 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.697512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-socket\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.697651 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.697530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istiod-ca-cert\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.697651 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.697550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-certs\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.697981 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.697920 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-credential-socket\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.698052 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.698001 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-socket\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.698194 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.698169 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-certs\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.698194 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.698187 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-data\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.698576 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.698552 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istiod-ca-cert\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.699918 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.699900 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-envoy\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.699989 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.699917 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-podinfo\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.713868 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.713842 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-token\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.715094 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.715071 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfqn4\" (UniqueName: \"kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-kube-api-access-pfqn4\") pod \"e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.810711 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.810602 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:34.995813 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:34.995773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl"] Jul 14 17:04:35.000727 ip-10-0-135-252 kubenswrapper[2564]: W0714 17:04:35.000700 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc776b61f_7fff_4b8b_bf3b_0b69efa1a08f.slice/crio-e1a3651340079b94047a51afdc471ceb179d85f731c187fdebce2bb4b1510156 WatchSource:0}: Error finding container e1a3651340079b94047a51afdc471ceb179d85f731c187fdebce2bb4b1510156: Status 404 returned error can't find the container with id e1a3651340079b94047a51afdc471ceb179d85f731c187fdebce2bb4b1510156 Jul 14 17:04:35.002909 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:35.002874 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:35.003014 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:35.002954 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:35.003014 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:35.003000 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:35.982504 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:35.982461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" event={"ID":"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f","Type":"ContainerStarted","Data":"9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1"} Jul 14 17:04:35.983088 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:35.982536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" event={"ID":"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f","Type":"ContainerStarted","Data":"e1a3651340079b94047a51afdc471ceb179d85f731c187fdebce2bb4b1510156"} Jul 14 17:04:36.025942 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:36.025890 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" podStartSLOduration=2.025874857 podStartE2EDuration="2.025874857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:04:36.022845581 +0000 UTC m=+2066.884234865" watchObservedRunningTime="2026-07-14 17:04:36.025874857 +0000 UTC m=+2066.887264139" Jul 14 17:04:36.811262 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:36.811229 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:36.815841 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:36.815815 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:36.991096 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:36.991069 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:36.995745 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:36.995716 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:42.019634 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:42.019599 2564 generic.go:356] "Generic (PLEG): container finished" podID="f720231b-a1a9-4527-b487-846979f9ad76" containerID="0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee" exitCode=0 Jul 14 17:04:42.020062 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:42.019674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" event={"ID":"f720231b-a1a9-4527-b487-846979f9ad76","Type":"ContainerDied","Data":"0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee"} Jul 14 17:04:42.020123 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:42.020115 2564 scope.go:117] "RemoveContainer" containerID="0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee" Jul 14 17:04:42.021183 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:42.021156 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:42.021237 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:42.021227 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:42.021272 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:42.021260 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:42.933077 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:42.933052 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:43.026600 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:43.026568 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" event={"ID":"f720231b-a1a9-4527-b487-846979f9ad76","Type":"ContainerStarted","Data":"feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d"} Jul 14 17:04:43.180564 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:43.180530 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:43.181525 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:43.181502 2564 patch_prober.go:28] interesting pod/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 14 17:04:43.181628 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:43.181550 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 14 17:04:44.181484 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:44.181442 2564 patch_prober.go:28] interesting pod/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 14 17:04:44.182002 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:44.181509 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 14 17:04:45.181164 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:45.181129 2564 patch_prober.go:28] interesting pod/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 14 17:04:45.181485 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:45.181452 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 14 17:04:46.181799 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:46.181747 2564 patch_prober.go:28] interesting pod/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 14 17:04:46.182303 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:46.181830 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 14 17:04:47.181402 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:47.181345 2564 patch_prober.go:28] interesting pod/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 14 17:04:47.181618 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:47.181436 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 14 17:04:48.188934 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:48.188903 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:48.189882 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:48.189853 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:48.191371 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:48.191352 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:04:53.032567 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:53.032527 2564 patch_prober.go:28] interesting pod/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 17:04:53.032987 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:53.032601 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 14 17:04:54.089353 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:54.089321 2564 generic.go:356] "Generic (PLEG): container finished" podID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerID="9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1" exitCode=0 Jul 14 17:04:54.089909 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:54.089418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" event={"ID":"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f","Type":"ContainerDied","Data":"9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1"} Jul 14 17:04:54.089983 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:54.089930 2564 scope.go:117] "RemoveContainer" containerID="9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1" Jul 14 17:04:54.091006 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:54.090980 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:54.091073 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:54.091062 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:54.091112 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:54.091097 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:04:55.101095 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:55.101060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" event={"ID":"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f","Type":"ContainerStarted","Data":"24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c"} Jul 14 17:04:55.810995 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:55.810964 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:55.811239 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:55.811216 2564 patch_prober.go:28] interesting pod/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 14 17:04:55.811341 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:55.811269 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 14 17:04:56.811044 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:56.811011 2564 patch_prober.go:28] interesting pod/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 14 17:04:56.811457 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:56.811068 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 14 17:04:57.811636 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:57.811603 2564 patch_prober.go:28] interesting pod/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 14 17:04:57.812027 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:57.811655 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 14 17:04:58.811567 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:58.811530 2564 patch_prober.go:28] interesting pod/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 14 17:04:58.811752 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:58.811589 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 14 17:04:59.814818 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:59.814785 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:59.815207 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:59.815044 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:04:59.815822 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:04:59.815804 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:11:18.111516 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:18.111487 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5"] Jul 14 17:11:18.112034 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:18.111686 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" containerID="cri-o://feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d" gracePeriod=30 Jul 14 17:11:18.192188 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:18.192144 2564 patch_prober.go:28] interesting pod/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 17:11:18.192402 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:18.192218 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 17:11:23.355435 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.355410 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:11:23.455288 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455259 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-socket\") pod \"f720231b-a1a9-4527-b487-846979f9ad76\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " Jul 14 17:11:23.455288 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455293 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-envoy\") pod \"f720231b-a1a9-4527-b487-846979f9ad76\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " Jul 14 17:11:23.455561 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455322 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f720231b-a1a9-4527-b487-846979f9ad76-istio-podinfo\") pod \"f720231b-a1a9-4527-b487-846979f9ad76\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " Jul 14 17:11:23.455561 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455354 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-data\") pod \"f720231b-a1a9-4527-b487-846979f9ad76\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " Jul 14 17:11:23.455561 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455433 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-certs\") pod \"f720231b-a1a9-4527-b487-846979f9ad76\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " Jul 14 17:11:23.455561 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455470 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f720231b-a1a9-4527-b487-846979f9ad76-istiod-ca-cert\") pod \"f720231b-a1a9-4527-b487-846979f9ad76\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " Jul 14 17:11:23.455802 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455567 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-istio-token\") pod \"f720231b-a1a9-4527-b487-846979f9ad76\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " Jul 14 17:11:23.455802 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455599 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f720231b-a1a9-4527-b487-846979f9ad76" (UID: "f720231b-a1a9-4527-b487-846979f9ad76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:11:23.455802 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455611 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5rz9\" (UniqueName: \"kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-kube-api-access-p5rz9\") pod \"f720231b-a1a9-4527-b487-846979f9ad76\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " Jul 14 17:11:23.455802 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455635 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-credential-socket\") pod \"f720231b-a1a9-4527-b487-846979f9ad76\" (UID: \"f720231b-a1a9-4527-b487-846979f9ad76\") " Jul 14 17:11:23.456018 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.455920 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f720231b-a1a9-4527-b487-846979f9ad76-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f720231b-a1a9-4527-b487-846979f9ad76" (UID: "f720231b-a1a9-4527-b487-846979f9ad76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:11:23.456018 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.456000 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f720231b-a1a9-4527-b487-846979f9ad76-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:23.456123 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.456018 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:23.456175 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.456121 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f720231b-a1a9-4527-b487-846979f9ad76" (UID: "f720231b-a1a9-4527-b487-846979f9ad76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:11:23.456175 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.456142 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f720231b-a1a9-4527-b487-846979f9ad76" (UID: "f720231b-a1a9-4527-b487-846979f9ad76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:11:23.456410 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.456368 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-data" (OuterVolumeSpecName: "istio-data") pod "f720231b-a1a9-4527-b487-846979f9ad76" (UID: "f720231b-a1a9-4527-b487-846979f9ad76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:11:23.457649 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.457623 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f720231b-a1a9-4527-b487-846979f9ad76" (UID: "f720231b-a1a9-4527-b487-846979f9ad76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:11:23.457766 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.457693 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-istio-token" (OuterVolumeSpecName: "istio-token") pod "f720231b-a1a9-4527-b487-846979f9ad76" (UID: "f720231b-a1a9-4527-b487-846979f9ad76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:11:23.457943 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.457925 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f720231b-a1a9-4527-b487-846979f9ad76-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f720231b-a1a9-4527-b487-846979f9ad76" (UID: "f720231b-a1a9-4527-b487-846979f9ad76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 17:11:23.458033 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.458015 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-kube-api-access-p5rz9" (OuterVolumeSpecName: "kube-api-access-p5rz9") pod "f720231b-a1a9-4527-b487-846979f9ad76" (UID: "f720231b-a1a9-4527-b487-846979f9ad76"). InnerVolumeSpecName "kube-api-access-p5rz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:11:23.556402 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.556360 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:23.556402 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.556401 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5rz9\" (UniqueName: \"kubernetes.io/projected/f720231b-a1a9-4527-b487-846979f9ad76-kube-api-access-p5rz9\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:23.556562 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.556412 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:23.556562 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.556422 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:23.556562 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.556430 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f720231b-a1a9-4527-b487-846979f9ad76-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:23.556562 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.556437 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:23.556562 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:23.556444 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f720231b-a1a9-4527-b487-846979f9ad76-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:24.110855 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.110822 2564 generic.go:356] "Generic (PLEG): container finished" podID="f720231b-a1a9-4527-b487-846979f9ad76" containerID="feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d" exitCode=0 Jul 14 17:11:24.111025 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.110872 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" Jul 14 17:11:24.111025 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.110908 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" event={"ID":"f720231b-a1a9-4527-b487-846979f9ad76","Type":"ContainerDied","Data":"feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d"} Jul 14 17:11:24.111025 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.110963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5" event={"ID":"f720231b-a1a9-4527-b487-846979f9ad76","Type":"ContainerDied","Data":"012b5bb2d23c441f3477d924b99e1d9492d7e7c1b2fa08c4a6750f6ff5119c15"} Jul 14 17:11:24.111025 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.110986 2564 scope.go:117] "RemoveContainer" containerID="feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d" Jul 14 17:11:24.121558 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.121543 2564 scope.go:117] "RemoveContainer" containerID="0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee" Jul 14 17:11:24.132615 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.132597 2564 scope.go:117] "RemoveContainer" containerID="feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d" Jul 14 17:11:24.132891 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:11:24.132868 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d\": container with ID starting with feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d not found: ID does not exist" containerID="feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d" Jul 14 17:11:24.132940 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.132903 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d"} err="failed to get container status \"feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d\": rpc error: code = NotFound desc = could not find container \"feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d\": container with ID starting with feb257487a9724f01cfb33fafb83c831be44dfc4bc9efe2cf27964b4a8077d8d not found: ID does not exist" Jul 14 17:11:24.132940 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.132925 2564 scope.go:117] "RemoveContainer" containerID="0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee" Jul 14 17:11:24.133185 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:11:24.133168 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee\": container with ID starting with 0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee not found: ID does not exist" containerID="0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee" Jul 14 17:11:24.133243 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.133191 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee"} err="failed to get container status \"0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee\": rpc error: code = NotFound desc = could not find container \"0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee\": container with ID starting with 0e64fb7c4541ddca01c676af27c7cff5eb83e6cd140668c9268360ec067860ee not found: ID does not exist" Jul 14 17:11:24.146585 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.146564 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5"] Jul 14 17:11:24.153620 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.153596 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-2f2de5-openshift-default-85c7c5ff7f-fbrk5"] Jul 14 17:11:24.494327 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:24.494293 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f720231b-a1a9-4527-b487-846979f9ad76" path="/var/lib/kubelet/pods/f720231b-a1a9-4527-b487-846979f9ad76/volumes" Jul 14 17:11:27.193966 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:27.193937 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl"] Jul 14 17:11:27.194557 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:27.194130 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" containerID="cri-o://24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c" gracePeriod=30 Jul 14 17:11:27.923658 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:27.923631 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d877d9695-9wqnn_3fafe409-8590-4023-a6cd-dfa0fde94572/authorino/0.log" Jul 14 17:11:29.818004 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:29.817973 2564 patch_prober.go:28] interesting pod/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 17:11:29.818358 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:29.818028 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 17:11:32.449801 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.449773 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:11:32.541573 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.541488 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-envoy\") pod \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " Jul 14 17:11:32.541573 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.541549 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-data\") pod \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " Jul 14 17:11:32.541806 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.541593 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfqn4\" (UniqueName: \"kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-kube-api-access-pfqn4\") pod \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " Jul 14 17:11:32.541806 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.541620 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istiod-ca-cert\") pod \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " Jul 14 17:11:32.541806 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.541645 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-podinfo\") pod \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " Jul 14 17:11:32.541806 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.541664 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-token\") pod \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " Jul 14 17:11:32.541806 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.541696 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-certs\") pod \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " Jul 14 17:11:32.541806 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.541724 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-credential-socket\") pod \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " Jul 14 17:11:32.541806 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.541756 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-socket\") pod \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\" (UID: \"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f\") " Jul 14 17:11:32.542151 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.542117 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" (UID: "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:11:32.542207 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.542143 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" (UID: "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:11:32.542305 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.542280 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" (UID: "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:11:32.542305 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.542298 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" (UID: "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:11:32.542530 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.542486 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" (UID: "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:11:32.543926 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.543900 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" (UID: "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:11:32.544047 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.543946 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" (UID: "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 17:11:32.544252 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.544236 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" (UID: "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:11:32.544313 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.544245 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-kube-api-access-pfqn4" (OuterVolumeSpecName: "kube-api-access-pfqn4") pod "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" (UID: "c776b61f-7fff-4b8b-bf3b-0b69efa1a08f"). InnerVolumeSpecName "kube-api-access-pfqn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:11:32.643583 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.643549 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfqn4\" (UniqueName: \"kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-kube-api-access-pfqn4\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:32.643583 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.643579 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istiod-ca-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:32.643583 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.643589 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-podinfo\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:32.643818 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.643597 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:32.643818 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.643606 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-certs\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:32.643818 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.643614 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-credential-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:32.643818 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.643622 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-workload-socket\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:32.643818 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.643631 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-envoy\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:32.643818 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:32.643638 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f-istio-data\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 14 17:11:33.159103 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.159068 2564 generic.go:356] "Generic (PLEG): container finished" podID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerID="24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c" exitCode=0 Jul 14 17:11:33.159299 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.159128 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" Jul 14 17:11:33.159299 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.159146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" event={"ID":"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f","Type":"ContainerDied","Data":"24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c"} Jul 14 17:11:33.159299 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.159196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl" event={"ID":"c776b61f-7fff-4b8b-bf3b-0b69efa1a08f","Type":"ContainerDied","Data":"e1a3651340079b94047a51afdc471ceb179d85f731c187fdebce2bb4b1510156"} Jul 14 17:11:33.159299 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.159220 2564 scope.go:117] "RemoveContainer" containerID="24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c" Jul 14 17:11:33.168699 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.168684 2564 scope.go:117] "RemoveContainer" containerID="9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1" Jul 14 17:11:33.176673 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.176658 2564 scope.go:117] "RemoveContainer" containerID="24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c" Jul 14 17:11:33.176936 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:11:33.176916 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c\": container with ID starting with 24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c not found: ID does not exist" containerID="24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c" Jul 14 17:11:33.176991 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.176944 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c"} err="failed to get container status \"24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c\": rpc error: code = NotFound desc = could not find container \"24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c\": container with ID starting with 24a1956296b4c10e7d0aff1c431fc1cadb900fecd142999935e79292a28ddc5c not found: ID does not exist" Jul 14 17:11:33.176991 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.176961 2564 scope.go:117] "RemoveContainer" containerID="9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1" Jul 14 17:11:33.177172 ip-10-0-135-252 kubenswrapper[2564]: E0714 17:11:33.177153 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1\": container with ID starting with 9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1 not found: ID does not exist" containerID="9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1" Jul 14 17:11:33.177222 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.177174 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1"} err="failed to get container status \"9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1\": rpc error: code = NotFound desc = could not find container \"9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1\": container with ID starting with 9c51d81cfbc0d3cfd72f725195fd14c1e0a75b05ac3125e66cc4a1f499b709c1 not found: ID does not exist" Jul 14 17:11:33.186562 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.186542 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl"] Jul 14 17:11:33.191412 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:33.191359 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-21db6d-openshift-default-7c75fc6595-qhwdl"] Jul 14 17:11:34.487293 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:34.487251 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" path="/var/lib/kubelet/pods/c776b61f-7fff-4b8b-bf3b-0b69efa1a08f/volumes" Jul 14 17:11:34.659214 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:34.659189 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq_ccfa645c-857e-4876-8329-38243f6c64e7/copy-manifests/0.log" Jul 14 17:11:34.669112 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:34.669090 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq_ccfa645c-857e-4876-8329-38243f6c64e7/manager/0.log" Jul 14 17:11:35.840989 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:35.840963 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2_f085c22a-2ae1-40bc-b077-6de40d58e69d/util/0.log" Jul 14 17:11:35.855458 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:35.855422 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2_f085c22a-2ae1-40bc-b077-6de40d58e69d/pull/0.log" Jul 14 17:11:35.866332 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:35.866308 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2_f085c22a-2ae1-40bc-b077-6de40d58e69d/extract/0.log" Jul 14 17:11:36.003227 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.003196 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb_62f59e3f-1e62-42d1-9e0d-94b99c24fdcd/util/0.log" Jul 14 17:11:36.012963 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.012940 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb_62f59e3f-1e62-42d1-9e0d-94b99c24fdcd/pull/0.log" Jul 14 17:11:36.029741 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.029718 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb_62f59e3f-1e62-42d1-9e0d-94b99c24fdcd/extract/0.log" Jul 14 17:11:36.160497 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.160471 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r_3a2dd81b-018a-4013-8223-31950c8981ac/extract/0.log" Jul 14 17:11:36.168184 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.168156 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r_3a2dd81b-018a-4013-8223-31950c8981ac/util/0.log" Jul 14 17:11:36.177926 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.177907 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r_3a2dd81b-018a-4013-8223-31950c8981ac/pull/0.log" Jul 14 17:11:36.297989 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.297967 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc_312befbc-3ee5-4ed5-b33b-6366adc5fce8/util/0.log" Jul 14 17:11:36.306899 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.306876 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc_312befbc-3ee5-4ed5-b33b-6366adc5fce8/pull/0.log" Jul 14 17:11:36.315674 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.315655 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc_312befbc-3ee5-4ed5-b33b-6366adc5fce8/extract/0.log" Jul 14 17:11:36.444278 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.444196 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d877d9695-9wqnn_3fafe409-8590-4023-a6cd-dfa0fde94572/authorino/0.log" Jul 14 17:11:36.848602 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:36.848531 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6fnkm_6cc8fd93-16ca-4164-8bcb-370c39906b09/kuadrant-console-plugin/0.log" Jul 14 17:11:37.759431 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:37.759400 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fl5fj_68c26db5-9ea1-4693-a70e-cde75d866545/istio-proxy/0.log" Jul 14 17:11:38.164610 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:38.164579 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f68dcd7b8-kf6dw_18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee/kube-auth-proxy/0.log" Jul 14 17:11:38.290270 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:38.290242 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qs2gp_ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7/istio-proxy/1.log" Jul 14 17:11:39.517783 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:39.517753 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db75c6q_19ff2588-a3a0-4ca4-bd8f-b62ac2049d42/main/0.log" Jul 14 17:11:43.884439 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884409 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v2qj6/must-gather-cf6wj"] Jul 14 17:11:43.884825 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884792 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" Jul 14 17:11:43.884825 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884807 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" Jul 14 17:11:43.884825 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884818 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" Jul 14 17:11:43.884825 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884823 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" Jul 14 17:11:43.884956 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884838 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" Jul 14 17:11:43.884956 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884844 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="74827688-9e17-4130-a8ff-705e4082df72" containerName="istio-proxy" Jul 14 17:11:43.884956 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884854 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" Jul 14 17:11:43.884956 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884859 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" Jul 14 17:11:43.884956 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884873 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" Jul 14 17:11:43.884956 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884881 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" Jul 14 17:11:43.885173 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884970 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" Jul 14 17:11:43.885173 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884984 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" Jul 14 17:11:43.885173 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884991 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f720231b-a1a9-4527-b487-846979f9ad76" containerName="istio-proxy" Jul 14 17:11:43.885173 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.884997 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c776b61f-7fff-4b8b-bf3b-0b69efa1a08f" containerName="istio-proxy" Jul 14 17:11:43.889506 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.889489 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2qj6/must-gather-cf6wj" Jul 14 17:11:43.894948 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.894923 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2qj6\"/\"kube-root-ca.crt\"" Jul 14 17:11:43.895051 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.895023 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2qj6\"/\"openshift-service-ca.crt\"" Jul 14 17:11:43.905898 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.905878 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2qj6/must-gather-cf6wj"] Jul 14 17:11:43.948561 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.948530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc4n8\" (UniqueName: \"kubernetes.io/projected/17f25299-5185-4ed6-9994-58fa6c2bf669-kube-api-access-sc4n8\") pod \"must-gather-cf6wj\" (UID: \"17f25299-5185-4ed6-9994-58fa6c2bf669\") " pod="openshift-must-gather-v2qj6/must-gather-cf6wj" Jul 14 17:11:43.948720 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:43.948571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17f25299-5185-4ed6-9994-58fa6c2bf669-must-gather-output\") pod \"must-gather-cf6wj\" (UID: \"17f25299-5185-4ed6-9994-58fa6c2bf669\") " pod="openshift-must-gather-v2qj6/must-gather-cf6wj" Jul 14 17:11:44.049743 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:44.049704 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17f25299-5185-4ed6-9994-58fa6c2bf669-must-gather-output\") pod \"must-gather-cf6wj\" (UID: \"17f25299-5185-4ed6-9994-58fa6c2bf669\") " pod="openshift-must-gather-v2qj6/must-gather-cf6wj" Jul 14 17:11:44.049913 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:44.049835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc4n8\" (UniqueName: \"kubernetes.io/projected/17f25299-5185-4ed6-9994-58fa6c2bf669-kube-api-access-sc4n8\") pod \"must-gather-cf6wj\" (UID: \"17f25299-5185-4ed6-9994-58fa6c2bf669\") " pod="openshift-must-gather-v2qj6/must-gather-cf6wj" Jul 14 17:11:44.050118 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:44.050098 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17f25299-5185-4ed6-9994-58fa6c2bf669-must-gather-output\") pod \"must-gather-cf6wj\" (UID: \"17f25299-5185-4ed6-9994-58fa6c2bf669\") " pod="openshift-must-gather-v2qj6/must-gather-cf6wj" Jul 14 17:11:44.071244 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:44.071215 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc4n8\" (UniqueName: \"kubernetes.io/projected/17f25299-5185-4ed6-9994-58fa6c2bf669-kube-api-access-sc4n8\") pod \"must-gather-cf6wj\" (UID: \"17f25299-5185-4ed6-9994-58fa6c2bf669\") " pod="openshift-must-gather-v2qj6/must-gather-cf6wj" Jul 14 17:11:44.198886 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:44.198849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2qj6/must-gather-cf6wj" Jul 14 17:11:44.341008 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:44.340988 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2qj6/must-gather-cf6wj"] Jul 14 17:11:44.342773 ip-10-0-135-252 kubenswrapper[2564]: W0714 17:11:44.342737 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17f25299_5185_4ed6_9994_58fa6c2bf669.slice/crio-ec29652e2f86631623fbacc9e212bd205080ade894680961a9e1ac0d279d4f72 WatchSource:0}: Error finding container ec29652e2f86631623fbacc9e212bd205080ade894680961a9e1ac0d279d4f72: Status 404 returned error can't find the container with id ec29652e2f86631623fbacc9e212bd205080ade894680961a9e1ac0d279d4f72 Jul 14 17:11:44.344495 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:44.344480 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 17:11:45.225954 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:45.225921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2qj6/must-gather-cf6wj" event={"ID":"17f25299-5185-4ed6-9994-58fa6c2bf669","Type":"ContainerStarted","Data":"ec29652e2f86631623fbacc9e212bd205080ade894680961a9e1ac0d279d4f72"} Jul 14 17:11:46.238925 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:46.238885 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2qj6/must-gather-cf6wj" event={"ID":"17f25299-5185-4ed6-9994-58fa6c2bf669","Type":"ContainerStarted","Data":"199da122e27fad2f3a46bcfbedf4727581623b80a48c9f364ec41119aa60c0ea"} Jul 14 17:11:46.239314 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:46.238943 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2qj6/must-gather-cf6wj" event={"ID":"17f25299-5185-4ed6-9994-58fa6c2bf669","Type":"ContainerStarted","Data":"40802a14e8f9aa80ea7c00d6f90174edd7c7f4873bdd8535d567e5a6a5d18c74"} Jul 14 17:11:46.275425 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:46.275363 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v2qj6/must-gather-cf6wj" podStartSLOduration=2.270802126 podStartE2EDuration="3.27534654s" totalImagesPullingTime="1.004544414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:11:46.274233525 +0000 UTC m=+2497.135622807" watchObservedRunningTime="2026-07-14 17:11:46.27534654 +0000 UTC m=+2497.136735822" Jul 14 17:11:47.415221 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:47.415188 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-snds6_dbb23d2d-86d9-4f61-a9fc-f02ac1fa4da0/global-pull-secret-syncer/0.log" Jul 14 17:11:47.564727 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:47.564702 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cjlks_7e065641-348b-46e7-a6aa-aa390353c034/konnectivity-agent/0.log" Jul 14 17:11:47.666118 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:47.666042 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-252.ec2.internal_bbcfbc2fdebeb48346da1bb838f11040/haproxy/0.log" Jul 14 17:11:51.294702 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.294667 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2_f085c22a-2ae1-40bc-b077-6de40d58e69d/extract/0.log" Jul 14 17:11:51.333400 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.333352 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2_f085c22a-2ae1-40bc-b077-6de40d58e69d/util/0.log" Jul 14 17:11:51.365647 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.365592 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fphk2_f085c22a-2ae1-40bc-b077-6de40d58e69d/pull/0.log" Jul 14 17:11:51.409149 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.409070 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb_62f59e3f-1e62-42d1-9e0d-94b99c24fdcd/extract/0.log" Jul 14 17:11:51.452118 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.452091 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb_62f59e3f-1e62-42d1-9e0d-94b99c24fdcd/util/0.log" Jul 14 17:11:51.541959 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.541914 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vcjb_62f59e3f-1e62-42d1-9e0d-94b99c24fdcd/pull/0.log" Jul 14 17:11:51.623936 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.623826 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r_3a2dd81b-018a-4013-8223-31950c8981ac/extract/0.log" Jul 14 17:11:51.715741 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.715704 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r_3a2dd81b-018a-4013-8223-31950c8981ac/util/0.log" Jul 14 17:11:51.772785 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.772751 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pm57r_3a2dd81b-018a-4013-8223-31950c8981ac/pull/0.log" Jul 14 17:11:51.819285 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.819258 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc_312befbc-3ee5-4ed5-b33b-6366adc5fce8/extract/0.log" Jul 14 17:11:51.855214 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.855170 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc_312befbc-3ee5-4ed5-b33b-6366adc5fce8/util/0.log" Jul 14 17:11:51.892173 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:51.892152 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zt2rc_312befbc-3ee5-4ed5-b33b-6366adc5fce8/pull/0.log" Jul 14 17:11:52.522311 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:52.522277 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d877d9695-9wqnn_3fafe409-8590-4023-a6cd-dfa0fde94572/authorino/0.log" Jul 14 17:11:52.682311 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:52.682279 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6fnkm_6cc8fd93-16ca-4164-8bcb-370c39906b09/kuadrant-console-plugin/0.log" Jul 14 17:11:55.219901 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:55.219811 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d7df5546c-zcnk2_3a11b187-18ac-4b04-bc9a-44dcc213c49a/metrics-server/0.log" Jul 14 17:11:55.461030 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:55.460993 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9m8jn_2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca/node-exporter/0.log" Jul 14 17:11:55.522308 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:55.522219 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9m8jn_2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca/kube-rbac-proxy/0.log" Jul 14 17:11:55.586422 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:55.586396 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9m8jn_2412f70d-ac6c-4e08-82c2-1c5bffb5e9ca/init-textfile/0.log" Jul 14 17:11:56.184523 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.184495 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-4flx2_13535f84-aaac-4092-840c-bef57c5f1b6e/prometheus-operator/0.log" Jul 14 17:11:56.218033 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.218004 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-4flx2_13535f84-aaac-4092-840c-bef57c5f1b6e/kube-rbac-proxy/0.log" Jul 14 17:11:56.261265 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.261236 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-gpdx2_e4d6d451-46b0-49e2-aa4f-9d86ba8e3850/prometheus-operator-admission-webhook/0.log" Jul 14 17:11:56.305995 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.305956 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84766bdf9f-c5dvt_ebc65df5-777f-46f8-9ff8-dd9c0a7155ba/telemeter-client/0.log" Jul 14 17:11:56.351284 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.351260 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84766bdf9f-c5dvt_ebc65df5-777f-46f8-9ff8-dd9c0a7155ba/reload/0.log" Jul 14 17:11:56.398211 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.398189 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84766bdf9f-c5dvt_ebc65df5-777f-46f8-9ff8-dd9c0a7155ba/kube-rbac-proxy/0.log" Jul 14 17:11:56.444661 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.444587 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc797bb4c-c2wrl_60e579d0-b461-4ff3-be67-1a3b31aee7b0/thanos-query/0.log" Jul 14 17:11:56.478264 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.478240 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc797bb4c-c2wrl_60e579d0-b461-4ff3-be67-1a3b31aee7b0/kube-rbac-proxy-web/0.log" Jul 14 17:11:56.511735 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.511705 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc797bb4c-c2wrl_60e579d0-b461-4ff3-be67-1a3b31aee7b0/kube-rbac-proxy/0.log" Jul 14 17:11:56.548803 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.548776 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc797bb4c-c2wrl_60e579d0-b461-4ff3-be67-1a3b31aee7b0/prom-label-proxy/0.log" Jul 14 17:11:56.591898 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.591863 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc797bb4c-c2wrl_60e579d0-b461-4ff3-be67-1a3b31aee7b0/kube-rbac-proxy-rules/0.log" Jul 14 17:11:56.625451 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.625421 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc797bb4c-c2wrl_60e579d0-b461-4ff3-be67-1a3b31aee7b0/kube-rbac-proxy-metrics/0.log" Jul 14 17:11:56.763226 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.763135 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls"] Jul 14 17:11:56.768195 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.768168 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.771211 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.771186 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v2qj6\"/\"default-dockercfg-d8lld\"" Jul 14 17:11:56.784889 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.784865 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls"] Jul 14 17:11:56.891874 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.891839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-sys\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.892059 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.891943 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-lib-modules\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.892059 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.892013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-proc\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.892181 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.892100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qkw7\" (UniqueName: \"kubernetes.io/projected/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-kube-api-access-5qkw7\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.892241 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.892181 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-podres\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.993774 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.993728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-podres\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.993964 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.993791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-sys\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.993964 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.993843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-lib-modules\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.993964 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.993884 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-sys\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.993964 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.993901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-proc\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.993964 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.993913 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-podres\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.993964 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.993958 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-proc\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.994273 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.993981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qkw7\" (UniqueName: \"kubernetes.io/projected/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-kube-api-access-5qkw7\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:56.994273 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:56.994026 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-lib-modules\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:57.008276 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:57.008245 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qkw7\" (UniqueName: \"kubernetes.io/projected/4dfab7e6-dc6c-4ad5-a930-0a38419f4f96-kube-api-access-5qkw7\") pod \"perf-node-gather-daemonset-l95ls\" (UID: \"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:57.084599 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:57.084497 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:57.256761 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:57.255896 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls"] Jul 14 17:11:57.337848 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:57.337695 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" event={"ID":"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96","Type":"ContainerStarted","Data":"d4c0af75cbae80a8d2fc4e33401a2b8bf96c7cdb7751275ebac3f7cee24be12f"} Jul 14 17:11:57.809197 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:57.809165 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-4xn4t_2a93af83-7f49-4e78-98d5-d25a838926b2/networking-console-plugin/0.log" Jul 14 17:11:58.344777 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:58.344737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" event={"ID":"4dfab7e6-dc6c-4ad5-a930-0a38419f4f96","Type":"ContainerStarted","Data":"2b9ca283812467d09ff4a4ba31dac226631cc82449f24ed5ef2ecf416ccc653c"} Jul 14 17:11:58.345206 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:58.344848 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:11:58.369563 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:58.369506 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" podStartSLOduration=2.369488712 podStartE2EDuration="2.369488712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:11:58.368010021 +0000 UTC m=+2509.229399317" watchObservedRunningTime="2026-07-14 17:11:58.369488712 +0000 UTC m=+2509.230877997" Jul 14 17:11:59.005109 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:59.005078 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78dd79866f-bbpvc_472a8db5-32cd-4f3a-88e3-87b136c05535/console/0.log" Jul 14 17:11:59.071199 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:11:59.071158 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-jsf6w_84db6128-6bbe-45af-a180-f48a5f6d9dce/download-server/0.log" Jul 14 17:12:01.245931 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:01.245860 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tlwtx_9e1ba60b-db2a-4b86-b3c1-5f302158c983/dns/0.log" Jul 14 17:12:01.276757 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:01.276728 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tlwtx_9e1ba60b-db2a-4b86-b3c1-5f302158c983/kube-rbac-proxy/0.log" Jul 14 17:12:01.379363 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:01.379335 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qjts_68ac6474-3dc9-46a3-95ce-19a2210f461e/dns-node-resolver/0.log" Jul 14 17:12:02.085955 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:02.085928 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5f88dd9f97-kdkd6_314f3137-6e1a-43e4-a5b9-6585710c31e0/registry/0.log" Jul 14 17:12:02.207092 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:02.207064 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wvd67_8441833e-789c-4a31-ab22-3ad366b2b974/node-ca/0.log" Jul 14 17:12:03.323042 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:03.323005 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fl5fj_68c26db5-9ea1-4693-a70e-cde75d866545/istio-proxy/0.log" Jul 14 17:12:03.508951 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:03.508918 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f68dcd7b8-kf6dw_18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee/kube-auth-proxy/0.log" Jul 14 17:12:03.553409 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:03.553357 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qs2gp_ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7/istio-proxy/0.log" Jul 14 17:12:03.592228 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:03.592144 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qs2gp_ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7/istio-proxy/1.log" Jul 14 17:12:04.361407 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:04.361353 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-l95ls" Jul 14 17:12:04.680112 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:04.680080 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9bkj9_ebbd65a7-ace1-4d2b-a5b0-7fac0ab99900/serve-healthcheck-canary/0.log" Jul 14 17:12:05.475718 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:05.475690 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fph2g_09ca01b7-a9db-4fa3-a8d6-512877ad90aa/kube-rbac-proxy/0.log" Jul 14 17:12:05.516196 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:05.516166 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fph2g_09ca01b7-a9db-4fa3-a8d6-512877ad90aa/exporter/0.log" Jul 14 17:12:05.568100 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:05.568075 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fph2g_09ca01b7-a9db-4fa3-a8d6-512877ad90aa/extractor/0.log" Jul 14 17:12:07.444115 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:07.444082 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fl5fj_68c26db5-9ea1-4693-a70e-cde75d866545/istio-proxy/0.log" Jul 14 17:12:07.589489 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:07.589462 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f68dcd7b8-kf6dw_18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee/kube-auth-proxy/0.log" Jul 14 17:12:07.618477 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:07.618099 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qs2gp_ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7/istio-proxy/0.log" Jul 14 17:12:07.653605 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:07.653571 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qs2gp_ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7/istio-proxy/1.log" Jul 14 17:12:08.981174 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:08.981141 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fl5fj_68c26db5-9ea1-4693-a70e-cde75d866545/istio-proxy/0.log" Jul 14 17:12:09.175871 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:09.175847 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f68dcd7b8-kf6dw_18cca59e-9eb3-4ea9-aa7c-41ae27e2c4ee/kube-auth-proxy/0.log" Jul 14 17:12:09.199196 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:09.199172 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qs2gp_ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7/istio-proxy/0.log" Jul 14 17:12:09.232236 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:09.232165 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qs2gp_ebfe732e-c4da-4f50-9bb8-dd4b57fc14f7/istio-proxy/1.log" Jul 14 17:12:09.495535 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:09.495445 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq_ccfa645c-857e-4876-8329-38243f6c64e7/manager/0.log" Jul 14 17:12:09.542975 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:09.542948 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-gs5fq_ccfa645c-857e-4876-8329-38243f6c64e7/copy-manifests/0.log" Jul 14 17:12:11.151893 ip-10-0-135-252 kubenswrapper[2564]: I0714 17:12:11.151857 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7889f65889-hxvfj_683f983e-9ed2-4dab-924f-6920f4574e58/manager/0.log"